Nov 03 17:24:40 user nova-compute[75463]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75463) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75463) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75463) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 03 17:24:40 user nova-compute[75463]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:24:40 user nova-compute[75463]: INFO nova.virt.driver [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 03 17:24:40 user nova-compute[75463]: INFO nova.compute.provider_config [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Acquiring lock "singleton_lock" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Acquired lock "singleton_lock" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Releasing lock "singleton_lock" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Full set of CONF: {{(pid=75463) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ******************************************************************************** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Configuration options gathered from: {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ================================================================================ {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] allow_resize_to_same_host      = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] arq_binding_timeout            = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] backdoor_port                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] backdoor_socket                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] block_device_allocate_retries  = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] block_device_allocate_retries_interval = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cert                           = self.pem {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute_monitors               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] config_dir                     = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] config_drive_format            = iso9660 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] config_source                  = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] console_host                   = user {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] control_exchange               = nova {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cpu_allocation_ratio           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] daemon                         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] debug                          = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_access_ip_network_name = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_availability_zone      = nova {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_ephemeral_format       = ext4 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_green_pool_size        = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] default_schedule_zone          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] disk_allocation_ratio          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] enable_new_services            = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] enabled_ssl_apis               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] flat_injected                  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] force_config_drive             = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] force_raw_images               = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] graceful_shutdown_timeout      = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] heal_instance_info_cache_interval = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] host                           = user {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_build_timeout         = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_delete_interval       = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_name_template         = instance-%08x {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_usage_audit           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_usage_audit_period    = month {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] internal_service_availability_zone = internal {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] key                            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] live_migration_retry_count     = 30 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_config_append              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_dir                        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_file                       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_options                    = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_rotate_interval            = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_rotate_interval_type       = days {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] log_rotation_type              = none {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] long_rpc_timeout               = 1800 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_concurrent_builds          = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_concurrent_live_migrations = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_concurrent_snapshots       = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_local_block_devices        = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_logfile_count              = 30 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] max_logfile_size_mb            = 200 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] maximum_instance_delete_attempts = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metadata_listen                = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metadata_listen_port           = 8775 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metadata_workers               = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] migrate_max_retries            = -1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] mkisofs_cmd                    = genisoimage {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] my_ip                          = 10.0.0.210 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] network_allocate_retries       = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] osapi_compute_listen_port      = 8774 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] osapi_compute_unique_server_name_scope =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] osapi_compute_workers          = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] password_length                = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] periodic_enable                = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] periodic_fuzzy_delay           = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] pointer_model                  = ps2mouse {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] preallocate_images             = none {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] publish_errors                 = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] pybasedir                      = /opt/stack/nova {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ram_allocation_ratio           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rate_limit_burst               = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rate_limit_except_level        = CRITICAL {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rate_limit_interval            = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reboot_timeout                 = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reclaim_instance_interval      = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] record                         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reimage_timeout_per_gb         = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] report_interval                = 120 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rescue_timeout                 = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reserved_host_cpus             = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reserved_host_disk_mb          = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reserved_host_memory_mb        = 512 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] reserved_huge_pages            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] resize_confirm_window          = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] resize_fs_using_block_device   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] resume_guests_state_on_host_boot = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rpc_response_timeout           = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] run_external_periodic_tasks    = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] running_deleted_instance_action = reap {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] running_deleted_instance_timeout = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler_instance_sync_interval = 120 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_down_time              = 720 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] servicegroup_driver            = db {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] shelved_offload_time           = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] shelved_poll_interval          = 3600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] shutdown_timeout               = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] source_is_ipv6                 = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ssl_only                       = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] state_path                     = /opt/stack/data/nova {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] sync_power_state_interval      = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] sync_power_state_pool_size     = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] syslog_log_facility            = LOG_USER {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] tempdir                        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] timeout_nbd                    = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] transport_url                  = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] update_resources_interval      = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_cow_images                 = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_eventlog                   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_journal                    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_json                       = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_rootwrap_daemon            = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_stderr                     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] use_syslog                     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vcpu_pin_set                   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plugging_is_fatal          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plugging_timeout           = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] virt_mkfs                      = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] volume_usage_poll_interval     = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] watch_log_file                 = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] web                            = /usr/share/spice-html5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_concurrency.disable_process_locking = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.auth_strategy              = keystone {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.compute_link_prefix        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.dhcp_domain                = novalocal {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.enable_instance_password   = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.glance_link_prefix         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.instance_list_per_project_cells = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.list_records_by_skipping_down_cells = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.local_metadata_per_cell    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.max_limit                  = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.metadata_cache_expiration  = 15 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.neutron_default_tenant_id  = default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.use_forwarded_for          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.use_neutron_default_nets   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_dynamic_targets = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_jsonfile_path   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.backend_argument         = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.config_prefix            = cache.oslo {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.dead_timeout             = 60.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.debug_cache_backend      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.enable_retry_client      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.enable_socket_keepalive  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.enabled                  = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.expiration_time          = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.hashclient_retry_attempts = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_dead_retry      = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_password        =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_sasl_enabled    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.memcache_username        =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.proxies                  = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.retry_attempts           = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.retry_delay              = 0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.socket_keepalive_count   = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.socket_keepalive_idle    = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.socket_keepalive_interval = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.tls_allowed_ciphers      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.tls_cafile               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.tls_certfile             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.tls_enabled              = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cache.tls_keyfile              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.auth_section            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.auth_type               = password {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.cafile                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.certfile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.collect_timing          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:40 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.cross_az_attach         = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.debug                   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.endpoint_template       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.http_retries            = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.insecure                = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.keyfile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.os_region_name          = RegionOne {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.split_loggers           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cinder.timeout                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.cpu_dedicated_set      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.cpu_shared_set         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.image_type_exclude_list = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.resource_provider_association_refresh = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.shutdown_retry_interval = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] conductor.workers              = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] console.allowed_origins        = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] console.ssl_ciphers            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] console.ssl_minimum_version    = default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] consoleauth.token_ttl          = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.cafile                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.certfile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.collect_timing          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.connect_retries         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.connect_retry_delay     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.endpoint_override       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.insecure                = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.keyfile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.max_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.min_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.region_name             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.service_name            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.service_type            = accelerator {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.split_loggers           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.status_code_retries     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.timeout                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] cyborg.version                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.backend               = sqlalchemy {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.connection            = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.connection_debug      = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.connection_parameters =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.connection_recycle_time = 3600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.connection_trace      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.db_inc_retry_interval = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.db_max_retries        = 20 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.db_max_retry_interval = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.db_retry_interval     = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.max_overflow          = 50 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.max_pool_size         = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.max_retries           = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.mysql_wsrep_sync_wait = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.pool_timeout          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.retry_interval        = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.slave_connection      = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] database.sqlite_synchronous    = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.backend           = sqlalchemy {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.connection        = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.connection_debug  = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.connection_parameters =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.connection_recycle_time = 3600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.connection_trace  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.db_inc_retry_interval = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.db_max_retries    = 20 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.db_max_retry_interval = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.db_retry_interval = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.max_overflow      = 50 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.max_pool_size     = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.max_retries       = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.pool_timeout      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.retry_interval    = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.slave_connection  = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] api_database.sqlite_synchronous = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] devices.enabled_mdev_types     = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ephemeral_storage_encryption.enabled = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.api_servers             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.cafile                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.certfile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.collect_timing          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.connect_retries         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.connect_retry_delay     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.debug                   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.default_trusted_certificate_ids = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.enable_certificate_validation = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.enable_rbd_download     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.endpoint_override       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.insecure                = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.keyfile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.max_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.min_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.num_retries             = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.rbd_ceph_conf           =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.rbd_connect_timeout     = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.rbd_pool                =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.rbd_user                =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.region_name             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.service_name            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.service_type            = image {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.split_loggers           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.status_code_retries     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.timeout                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.verify_glance_signatures = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] glance.version                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] guestfs.debug                  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.config_drive_cdrom      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.config_drive_inject_password = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.enable_remotefx         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.instances_path_share    =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.limit_cpu_features      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.use_multipath_io        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.vswitch_name            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] mks.enabled                    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.manager_interval   = 2400 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.precache_concurrency = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.remove_unused_base_images = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] image_cache.subdirectory_name  = _base {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.api_max_retries         = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.api_retry_interval      = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.auth_section            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.auth_type               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.cafile                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.certfile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.collect_timing          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.conductor_group         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.connect_retries         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.connect_retry_delay     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.endpoint_override       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.insecure                = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.keyfile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.max_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.min_version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.peer_list               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.region_name             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.serial_console_state_timeout = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.service_name            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.service_type            = baremetal {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.split_loggers           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.status_code_retries     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.timeout                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ironic.version                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] key_manager.fixed_key          = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.barbican_api_version  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.barbican_endpoint     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.barbican_endpoint_type = public {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.barbican_region_name  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.cafile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.certfile              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.collect_timing        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.insecure              = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.keyfile               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.number_of_retries     = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.retry_delay           = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.send_service_user_token = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.split_loggers         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.timeout               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.verify_ssl            = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican.verify_ssl_path       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.auth_section = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.auth_type = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.cafile   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.certfile = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.collect_timing = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.insecure = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.keyfile  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.split_loggers = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] barbican_service_user.timeout  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.approle_role_id          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.approle_secret_id        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.cafile                   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.certfile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.collect_timing           = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.insecure                 = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.keyfile                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.kv_mountpoint            = secret {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.kv_path                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.kv_version               = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.namespace                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.root_token_id            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.split_loggers            = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.ssl_ca_crt_file          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.timeout                  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.use_ssl                  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.auth_section          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.auth_type             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.cafile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.certfile              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.collect_timing        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.connect_retries       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.connect_retry_delay   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.endpoint_override     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.insecure              = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.keyfile               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.max_version           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.min_version           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.region_name           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.service_name          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.service_type          = identity {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.split_loggers         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.status_code_retries   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.timeout               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] keystone.version               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.connection_uri         =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_mode               = custom {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: WARNING oslo_config.cfg [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_power_governor_high = performance {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_power_management   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.device_detach_attempts = 8 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.device_detach_timeout  = 20 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.disk_cachemodes        = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.disk_prefix            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.enabled_perf_events    = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.file_backed_memory     = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.gid_maps               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.hw_disk_discard        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.hw_machine_type        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_rbd_pool        = rbd {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_type            = default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.images_volume_group    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.inject_key             = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.inject_partition       = -2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.inject_password        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.iscsi_iface            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.iser_use_multipath     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_downtime = 500 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_inbound_addr = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_scheme  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_timeout_action = abort {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_tunnelled = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: WARNING oslo_config.cfg [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 03 17:24:41 user nova-compute[75463]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 03 17:24:41 user nova-compute[75463]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 03 17:24:41 user nova-compute[75463]: and ``live_migration_inbound_addr`` respectively.
Nov 03 17:24:41 user nova-compute[75463]: ).  Its value may be silently ignored in the future.
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.live_migration_with_native_tls = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.max_queues             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.nfs_mount_options      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_pcie_ports         = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.pmem_namespaces        = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.quobyte_client_cfg     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rbd_secret_uuid        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rbd_user               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rescue_image_id        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rescue_kernel_id       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.rx_queue_size          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.smbfs_mount_options    =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.snapshot_compression   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.snapshot_image_format  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.sparse_logical_volumes = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.swtpm_enabled          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.swtpm_group            = tss {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.swtpm_user             = tss {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.sysinfo_serial         = unique {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.tb_cache_size          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.tx_queue_size          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.uid_maps               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.use_virtio_for_bridges = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.virt_type              = kvm {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.volume_clear           = zero {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.volume_clear_size      = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.volume_use_multipath   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_cache_path   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.auth_section           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.auth_type              = password {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.cafile                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.certfile               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.collect_timing         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.connect_retries        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.connect_retry_delay    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.default_floating_pool  = public {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.endpoint_override      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.extension_sync_interval = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.http_retries           = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.insecure               = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.keyfile                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.max_version            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.min_version            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.ovs_bridge             = br-int {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.physnets               = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.region_name            = RegionOne {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.service_metadata_proxy = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.service_name           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.service_type           = network {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.split_loggers          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.status_code_retries    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.timeout                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] neutron.version                = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] notifications.bdms_in_notifications = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] notifications.default_level    = INFO {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] notifications.notification_format = unversioned {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] notifications.notify_on_state_change = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] pci.alias                      = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] pci.device_spec                = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] pci.report_in_placement        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.auth_section         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.auth_type            = password {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.cafile               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.certfile             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.collect_timing       = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.connect_retries      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.connect_retry_delay  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.default_domain_id    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.default_domain_name  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.domain_id            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.domain_name          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.endpoint_override    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.insecure             = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.keyfile              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.max_version          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.min_version          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.password             = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.project_domain_id    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.project_domain_name  = Default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.project_id           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.project_name         = service {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.region_name          = RegionOne {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.service_name         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.service_type         = placement {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.split_loggers        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.status_code_retries  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.system_scope         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.timeout              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.trust_id             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.user_domain_id       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.user_domain_name     = Default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.user_id              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.username             = placement {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] placement.version              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.cores                    = 20 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.count_usage_from_placement = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.injected_file_content_bytes = 10240 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.injected_file_path_length = 255 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.injected_files           = 5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.instances                = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.key_pairs                = 100 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.metadata_items           = 128 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.ram                      = 51200 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.recheck_quota            = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.server_group_members     = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] quota.server_groups            = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rdp.enabled                    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.image_metadata_prefilter = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.max_attempts         = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.max_placement_results = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] scheduler.workers              = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.host_subset_size = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.isolated_hosts = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.isolated_images = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.pci_in_placement = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.track_instance_changes = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metrics.required               = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metrics.weight_multiplier      = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] metrics.weight_setting         = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.enabled         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.port_range      = 10000:20000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] serial_console.serialproxy_port = 6083 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.auth_section      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.auth_type         = password {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.cafile            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.certfile          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.collect_timing    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.insecure          = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.keyfile           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.send_service_user_token = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.split_loggers     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] service_user.timeout           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.agent_enabled            = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.enabled                  = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.html5proxy_port          = 6082 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.image_compression        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.jpeg_compression         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.playback_compression     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.server_listen            = 127.0.0.1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.streaming_mode           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] spice.zlib_compression         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] upgrade_levels.baseapi         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] upgrade_levels.cert            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] upgrade_levels.compute         = auto {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] upgrade_levels.conductor       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] upgrade_levels.scheduler       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.cafile = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.certfile = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.insecure = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vendordata_dynamic_auth.timeout = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.api_retry_count         = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.ca_file                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.cache_prefix            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.cluster_name            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.connection_pool_size    = 10 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.console_delay_seconds   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.datastore_regex         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.host_ip                 = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.host_password           = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.host_port               = 443 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.host_username           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.insecure                = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.integration_bridge      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.maximum_objects         = 100 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.pbm_default_policy      = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.pbm_enabled             = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.pbm_wsdl_location       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.serial_port_proxy_uri   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.serial_port_service_uri = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.task_poll_interval      = 0.5 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.use_linked_clone        = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.vnc_keymap              = en-us {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.vnc_port                = 5900 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vmware.vnc_port_total          = 10000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.auth_schemes               = ['none'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.enabled                    = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.novncproxy_port            = 6080 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.vencrypt_ca_certs          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.vencrypt_client_cert       = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vnc.vencrypt_client_key        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.disable_rootwrap   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.enable_numa_live_migration = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.libvirt_disable_apic = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.client_socket_timeout     = 900 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.default_pool_size         = 1000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.keep_alive                = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.max_header_line           = 16384 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.ssl_ca_file               = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.ssl_cert_file             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.ssl_key_file              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.tcp_keepidle              = 600 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] zvm.ca_file                    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] zvm.cloud_connector_url        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] zvm.reachable_timeout          = 300 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.enforce_new_defaults = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.enforce_scope      = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.policy_default_rule = default {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.connection_string     = messaging:// {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.enabled               = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.es_doc_type           = notification {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.es_scroll_size        = 10000 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.es_scroll_time        = 2m {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.filter_error_trace    = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.hmac_keys             = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.sentinel_service_name = mymaster {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.socket_timeout        = 0.1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.trace_requests        = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler.trace_sqlalchemy      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler_jaeger.process_tags   = {} {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler_jaeger.service_name_prefix = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] profiler_otlp.service_name_prefix = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] remote_debug.host              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] remote_debug.port              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_notifications.retry = -1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.auth_section        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.auth_type           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.cafile              = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.certfile            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.collect_timing      = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.connect_retries     = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.connect_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.endpoint_id         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.endpoint_override   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.insecure            = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.keyfile             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.max_version         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.min_version         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.region_name         = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.service_name        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.service_type        = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.split_loggers       = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.status_code_retries = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.status_code_retry_delay = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.timeout             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.valid_interfaces    = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_limit.version             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_reports.file_event_handler = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] oslo_reports.log_dir           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.group  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] vif_plug_ovs_privileged.user   = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.isolate_vif         = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] os_brick.lock_path             = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.capabilities   = [21] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.group          = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.helper_command = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] privsep_osbrick.user           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.group           = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.helper_command  = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] nova_sys_admin.user            = None {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG oslo_service.service [None req-eeba634f-058b-41bc-b94f-b5035f2de99a None None] ******************************************************************************** {{(pid=75463) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 03 17:24:41 user nova-compute[75463]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Connecting to libvirt: qemu:///system {{(pid=75463) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe014337040> {{(pid=75463) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 03 17:24:41 user nova-compute[75463]: libvirt:  error : internal error: could not initialize domain event timer
Nov 03 17:24:41 user nova-compute[75463]: WARNING nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe014337040> {{(pid=75463) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Starting native event thread {{(pid=75463) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Starting green dispatch thread {{(pid=75463) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Starting connection event dispatch thread {{(pid=75463) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 03 17:24:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Connection event '1' reason 'None'
Nov 03 17:24:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 17:24:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.mount [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Initialising _HostMountState generation 0 {{(pid=75463) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 03 17:24:48 user nova-compute[75463]: INFO nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host capabilities <capabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <host>
Nov 03 17:24:48 user nova-compute[75463]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 03 17:24:48 user nova-compute[75463]:     <cpu>
Nov 03 17:24:48 user nova-compute[75463]:       <arch>x86_64</arch>
Nov 03 17:24:48 user nova-compute[75463]:       <model>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <microcode version='1070'/>
Nov 03 17:24:48 user nova-compute[75463]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='osxsave'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='invtsc'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='rsba'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature name='skip-l1dfl-vmentry'/>
Nov 03 17:24:48 user nova-compute[75463]:       <pages unit='KiB' size='4'/>
Nov 03 17:24:48 user nova-compute[75463]:       <pages unit='KiB' size='2048'/>
Nov 03 17:24:48 user nova-compute[75463]:     </cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <power_management>
Nov 03 17:24:48 user nova-compute[75463]:       <suspend_mem/>
Nov 03 17:24:48 user nova-compute[75463]:       <suspend_disk/>
Nov 03 17:24:48 user nova-compute[75463]:       <suspend_hybrid/>
Nov 03 17:24:48 user nova-compute[75463]:     </power_management>
Nov 03 17:24:48 user nova-compute[75463]:     <iommu support='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <migration_features>
Nov 03 17:24:48 user nova-compute[75463]:       <live/>
Nov 03 17:24:48 user nova-compute[75463]:       <uri_transports>
Nov 03 17:24:48 user nova-compute[75463]:         <uri_transport>tcp</uri_transport>
Nov 03 17:24:48 user nova-compute[75463]:         <uri_transport>rdma</uri_transport>
Nov 03 17:24:48 user nova-compute[75463]:       </uri_transports>
Nov 03 17:24:48 user nova-compute[75463]:     </migration_features>
Nov 03 17:24:48 user nova-compute[75463]:     <topology>
Nov 03 17:24:48 user nova-compute[75463]:       <cells num='2'>
Nov 03 17:24:48 user nova-compute[75463]:         <cell id='0'>
Nov 03 17:24:48 user nova-compute[75463]:           <memory unit='KiB'>8189224</memory>
Nov 03 17:24:48 user nova-compute[75463]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 03 17:24:48 user nova-compute[75463]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 17:24:48 user nova-compute[75463]:           <distances>
Nov 03 17:24:48 user nova-compute[75463]:             <sibling id='0' value='10'/>
Nov 03 17:24:48 user nova-compute[75463]:             <sibling id='1' value='20'/>
Nov 03 17:24:48 user nova-compute[75463]:           </distances>
Nov 03 17:24:48 user nova-compute[75463]:           <cpus num='6'>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 03 17:24:48 user nova-compute[75463]:           </cpus>
Nov 03 17:24:48 user nova-compute[75463]:         </cell>
Nov 03 17:24:48 user nova-compute[75463]:         <cell id='1'>
Nov 03 17:24:48 user nova-compute[75463]:           <memory unit='KiB'>8206460</memory>
Nov 03 17:24:48 user nova-compute[75463]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 03 17:24:48 user nova-compute[75463]:           <pages unit='KiB' size='2048'>0</pages>
Nov 03 17:24:48 user nova-compute[75463]:           <distances>
Nov 03 17:24:48 user nova-compute[75463]:             <sibling id='0' value='20'/>
Nov 03 17:24:48 user nova-compute[75463]:             <sibling id='1' value='10'/>
Nov 03 17:24:48 user nova-compute[75463]:           </distances>
Nov 03 17:24:48 user nova-compute[75463]:           <cpus num='6'>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 03 17:24:48 user nova-compute[75463]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 03 17:24:48 user nova-compute[75463]:           </cpus>
Nov 03 17:24:48 user nova-compute[75463]:         </cell>
Nov 03 17:24:48 user nova-compute[75463]:       </cells>
Nov 03 17:24:48 user nova-compute[75463]:     </topology>
Nov 03 17:24:48 user nova-compute[75463]:     <cache>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 03 17:24:48 user nova-compute[75463]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 03 17:24:48 user nova-compute[75463]:     </cache>
Nov 03 17:24:48 user nova-compute[75463]:     <secmodel>
Nov 03 17:24:48 user nova-compute[75463]:       <model>apparmor</model>
Nov 03 17:24:48 user nova-compute[75463]:       <doi>0</doi>
Nov 03 17:24:48 user nova-compute[75463]:     </secmodel>
Nov 03 17:24:48 user nova-compute[75463]:     <secmodel>
Nov 03 17:24:48 user nova-compute[75463]:       <model>dac</model>
Nov 03 17:24:48 user nova-compute[75463]:       <doi>0</doi>
Nov 03 17:24:48 user nova-compute[75463]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 03 17:24:48 user nova-compute[75463]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 03 17:24:48 user nova-compute[75463]:     </secmodel>
Nov 03 17:24:48 user nova-compute[75463]:   </host>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='alpha'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>clipper</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='armv6l'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>spitz</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>nuri</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>kzm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>z2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>tosa</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n810</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>terrier</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>midway</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>microbit</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>verdex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>highbank</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>akita</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>connex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>collie</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='armv7l'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>spitz</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>nuri</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>kzm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>z2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>tosa</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n810</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>terrier</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>midway</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>microbit</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>verdex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>highbank</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>akita</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>connex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>collie</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='aarch64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>integratorcp</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>borzoi</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>spitz</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>nuri</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-b1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatileab</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>kzm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>musca-a</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>smdkc210</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>z2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>tosa</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>sabrelite</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-eb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n810</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>n800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>versatilepb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>terrier</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mainstone</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>midway</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>musicpal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>microbit</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cubieboard</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>verdex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduino2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>raspi3b</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>raspi2b</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>cheetah</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>highbank</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>akita</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>connex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>collie</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>raspi0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <acpi default='on' toggle='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='cris'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='i686'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>isapc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>microvm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='kvm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <pae/>
Nov 03 17:24:48 user nova-compute[75463]:       <nonpae/>
Nov 03 17:24:48 user nova-compute[75463]:       <acpi default='on' toggle='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:       <apic default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='m68k'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>an5206</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>q800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>next-cube</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='microblaze'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='microblazeel'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='mips'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>malta</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='mipsel'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>malta</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='mips64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>malta</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>pica61</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>magnum</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='mips64el'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>malta</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mipssim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>pica61</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>magnum</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='16'>boston</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='ppc'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mac99</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>40p</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>taihu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='ppc64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>taihu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>40p</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mac99</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='ppc64le'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>taihu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ppce500</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>40p</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>pegasos2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>bamboo</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>g3beige</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>mac99</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sam460ex</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>ref405ep</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2048'>powernv8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='riscv32'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='8'>spike</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>opentitan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='8'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='riscv64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='8'>spike</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='5'>sifive_u</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>shakti_c</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sifive_e</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='8'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='s390x'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='sh4'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>shix</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>r2d</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='sh4eb'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>shix</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>r2d</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='sparc'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>SS-5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>SS-20</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>LX</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>SS-4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>SS-10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>Voyager</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='sparc64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sun4u</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>niagara</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>sun4v</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='x86_64'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>64</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>x-remote</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='1'>isapc</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>microvm</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='kvm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <acpi default='on' toggle='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:       <apic default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='xtensa'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>sim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>kc705</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ml605</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx200</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx60</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]:   <guest>
Nov 03 17:24:48 user nova-compute[75463]:     <os_type>hvm</os_type>
Nov 03 17:24:48 user nova-compute[75463]:     <arch name='xtensaeb'>
Nov 03 17:24:48 user nova-compute[75463]:       <wordsize>32</wordsize>
Nov 03 17:24:48 user nova-compute[75463]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='4'>sim</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>kc705</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ml605</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>virt</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx200</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>lx60</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 03 17:24:48 user nova-compute[75463]:       <domain type='qemu'/>
Nov 03 17:24:48 user nova-compute[75463]:     </arch>
Nov 03 17:24:48 user nova-compute[75463]:     <features>
Nov 03 17:24:48 user nova-compute[75463]:       <cpuselection/>
Nov 03 17:24:48 user nova-compute[75463]:       <deviceboot/>
Nov 03 17:24:48 user nova-compute[75463]:       <disksnapshot default='on' toggle='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     </features>
Nov 03 17:24:48 user nova-compute[75463]:   </guest>
Nov 03 17:24:48 user nova-compute[75463]: </capabilities>
Nov 03 17:24:48 user nova-compute[75463]: 
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-i440fx-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>i686</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='255'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'/>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='lm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ide</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-q35-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>i686</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='288'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'/>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='lm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-i440fx-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>i686</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='255'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'/>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='lm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ide</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-i386</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-q35-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>i686</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='288'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'/>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='lm'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'ubuntu', 'q35'} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-i440fx-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>x86_64</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='255'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>efi</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='invtsc'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='rsba'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ide</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-q35-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>x86_64</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='288'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>efi</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='invtsc'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='rsba'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-i440fx-jammy</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>x86_64</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='255'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>efi</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='invtsc'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='rsba'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ide</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 03 17:24:48 user nova-compute[75463]: <domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 03 17:24:48 user nova-compute[75463]:   <domain>kvm</domain>
Nov 03 17:24:48 user nova-compute[75463]:   <machine>pc-q35-6.2</machine>
Nov 03 17:24:48 user nova-compute[75463]:   <arch>x86_64</arch>
Nov 03 17:24:48 user nova-compute[75463]:   <vcpu max='288'/>
Nov 03 17:24:48 user nova-compute[75463]:   <iothreads supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:   <os supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='firmware'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>efi</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:     <loader supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>rom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pflash</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='readonly'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='secure'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>yes</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>no</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </loader>
Nov 03 17:24:48 user nova-compute[75463]:   </os>
Nov 03 17:24:48 user nova-compute[75463]:   <cpu>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-passthrough' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='hostPassthroughMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='maximum' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='maximumMigratable'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>on</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>off</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='host-model' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <vendor>Intel</vendor>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ss'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='vmx'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pcid'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='hypervisor'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arat'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='tsc_adjust'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='umip'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='md-clear'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='arch-capabilities'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='invtsc'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibpb'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='ibrs'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-stibp'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='amd-ssbd'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='rsba'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='require' name='pschange-mc-no'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='erms'/>
Nov 03 17:24:48 user nova-compute[75463]:       <feature policy='disable' name='xsaveopt'/>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:     <mode name='custom' supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>qemu64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>qemu32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>phenom</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>pentium</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>n270</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm64</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>kvm32</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>coreduo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>core2duo</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>athlon</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Westmere</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Snowridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Skylake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>SandyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Penryn</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G5</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G4</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G3</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Opteron_G2</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Opteron_G1</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>IvyBridge</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Icelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Haswell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Rome</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-Milan</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC-IBPB</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>EPYC</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Dhyana</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cooperlake</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>Conroe</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Cascadelake-Server</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-noTSX</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell-IBRS</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='no'>Broadwell</model>
Nov 03 17:24:48 user nova-compute[75463]:       <model usable='yes'>486</model>
Nov 03 17:24:48 user nova-compute[75463]:     </mode>
Nov 03 17:24:48 user nova-compute[75463]:   </cpu>
Nov 03 17:24:48 user nova-compute[75463]:   <memoryBacking supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:     <enum name='sourceType'>
Nov 03 17:24:48 user nova-compute[75463]:       <value>file</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>anonymous</value>
Nov 03 17:24:48 user nova-compute[75463]:       <value>memfd</value>
Nov 03 17:24:48 user nova-compute[75463]:     </enum>
Nov 03 17:24:48 user nova-compute[75463]:   </memoryBacking>
Nov 03 17:24:48 user nova-compute[75463]:   <devices>
Nov 03 17:24:48 user nova-compute[75463]:     <disk supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='diskDevice'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>disk</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cdrom</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>floppy</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>lun</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='bus'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>fdc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sata</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </disk>
Nov 03 17:24:48 user nova-compute[75463]:     <graphics supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='type'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>sdl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vnc</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>spice</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egl-headless</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </graphics>
Nov 03 17:24:48 user nova-compute[75463]:     <video supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='modelType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>cirrus</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>vmvga</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>qxl</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>none</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>bochs</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>ramfb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </video>
Nov 03 17:24:48 user nova-compute[75463]:     <hostdev supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='mode'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>subsystem</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='startupPolicy'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>default</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>mandatory</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>requisite</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>optional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='subsysType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>usb</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>pci</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>scsi</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='capsType'/>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='pciBackend'/>
Nov 03 17:24:48 user nova-compute[75463]:     </hostdev>
Nov 03 17:24:48 user nova-compute[75463]:     <rng supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtio-non-transitional</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>random</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>egd</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>builtin</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </rng>
Nov 03 17:24:48 user nova-compute[75463]:     <filesystem supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='driverType'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>path</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>handle</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>virtiofs</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </filesystem>
Nov 03 17:24:48 user nova-compute[75463]:     <tpm supported='yes'>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='model'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-tis</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>tpm-crb</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:       <enum name='backendModel'>
Nov 03 17:24:48 user nova-compute[75463]:         <value>passthrough</value>
Nov 03 17:24:48 user nova-compute[75463]:         <value>emulator</value>
Nov 03 17:24:48 user nova-compute[75463]:       </enum>
Nov 03 17:24:48 user nova-compute[75463]:     </tpm>
Nov 03 17:24:48 user nova-compute[75463]:   </devices>
Nov 03 17:24:48 user nova-compute[75463]:   <features>
Nov 03 17:24:48 user nova-compute[75463]:     <gic supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:     <vmcoreinfo supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <genid supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backingStoreInput supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <backup supported='yes'/>
Nov 03 17:24:48 user nova-compute[75463]:     <sev supported='no'/>
Nov 03 17:24:48 user nova-compute[75463]:   </features>
Nov 03 17:24:48 user nova-compute[75463]: </domainCapabilities>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75463) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75463) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75463) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75463) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Checking secure boot support for host arch (x86_64) {{(pid=75463) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 03 17:24:48 user nova-compute[75463]: INFO nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Secure Boot support detected
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] cpu compare xml: <cpu match="exact">
Nov 03 17:24:48 user nova-compute[75463]:   <model>Nehalem</model>
Nov 03 17:24:48 user nova-compute[75463]: </cpu>
Nov 03 17:24:48 user nova-compute[75463]:  {{(pid=75463) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 03 17:24:48 user nova-compute[75463]: INFO nova.virt.node [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Generated node identity 6300a99a-c996-4cbe-994c-ecbcd97eb045
Nov 03 17:24:48 user nova-compute[75463]: INFO nova.virt.node [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Wrote node identity 6300a99a-c996-4cbe-994c-ecbcd97eb045 to /opt/stack/data/nova/compute_id
Nov 03 17:24:48 user nova-compute[75463]: WARNING nova.compute.manager [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Compute nodes ['6300a99a-c996-4cbe-994c-ecbcd97eb045'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 03 17:24:48 user nova-compute[75463]: INFO nova.compute.manager [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 03 17:24:48 user nova-compute[75463]: WARNING nova.compute.manager [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 03 17:24:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:24:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:24:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:24:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Hypervisor/Node resource view: name=user free_ram=10874MB free_disk=26.234821319580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:24:49 user nova-compute[75463]: WARNING nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] No compute node record for user:6300a99a-c996-4cbe-994c-ecbcd97eb045: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6300a99a-c996-4cbe-994c-ecbcd97eb045 could not be found.
Nov 03 17:24:49 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Compute node record created for user:user with uuid: 6300a99a-c996-4cbe-994c-ecbcd97eb045
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:24:49 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] [req-d6135e3f-474f-44e3-a2ad-f44c6144fac4] Created resource provider record via placement API for resource provider with UUID 6300a99a-c996-4cbe-994c-ecbcd97eb045 and name user.
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75463) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 03 17:24:49 user nova-compute[75463]: INFO nova.virt.libvirt.host [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] kernel doesn't support AMD SEV
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Libvirt baseline CPU <cpu>
Nov 03 17:24:49 user nova-compute[75463]:   <arch>x86_64</arch>
Nov 03 17:24:49 user nova-compute[75463]:   <model>Nehalem</model>
Nov 03 17:24:49 user nova-compute[75463]:   <vendor>Intel</vendor>
Nov 03 17:24:49 user nova-compute[75463]:   <topology sockets="6" cores="1" threads="1"/>
Nov 03 17:24:49 user nova-compute[75463]: </cpu>
Nov 03 17:24:49 user nova-compute[75463]:  {{(pid=75463) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Updated inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Updating resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 generation from 0 to 1 during operation: update_inventory {{(pid=75463) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Updating resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 generation from 1 to 2 during operation: update_traits {{(pid=75463) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.service [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Creating RPC server for service compute {{(pid=75463) start /opt/stack/nova/nova/service.py:182}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.service [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] Join ServiceGroup membership for this service compute {{(pid=75463) start /opt/stack/nova/nova/service.py:199}}
Nov 03 17:24:49 user nova-compute[75463]: DEBUG nova.servicegroup.drivers.db [None req-3a7267ec-45ec-4cb0-8f0a-07330de0cdb5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75463) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:25:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:25:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:25:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=10279MB free_disk=26.00783920288086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:25:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:26:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:26:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=10287MB free_disk=26.072185516357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:26:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:26:42 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:26:42 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:26:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:26:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:26:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:27:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:27:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:27:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=10293MB free_disk=25.82571029663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:27:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:27:43 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:27:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:27:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:27:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:27:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:27:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:28:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:28:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:28:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:28:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:28:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9615MB free_disk=25.854095458984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:28:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:28:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:28:52 user nova-compute[75463]: INFO nova.compute.claims [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Claim successful on node user
Nov 03 17:28:52 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:28:53 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:28:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:28:53 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Creating image(s)
Nov 03 17:28:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "/opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "/opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "/opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.policy [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60c4a5139bae4304aed5c5fddebd9d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01d9d83719b645ecac611cdaec3b8c59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.part --force-share --output=json" returned: 0 in 0.216s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.virt.images [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] cf8a3394-bcc6-4ef0-a69c-469776200bf6 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.part /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:54 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:28:54 user nova-compute[75463]: INFO nova.compute.claims [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Claim successful on node user
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.part /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.converted" returned: 0 in 0.483s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.869s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjh3be2xl/privsep.sock']
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:28:55 user sudo[84952]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjh3be2xl/privsep.sock
Nov 03 17:28:55 user sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.651s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.compute.claims [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Claim successful on node user
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Creating image(s)
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.policy [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a37cd705cb44c191fe6fad731b4873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e727b9484bb4bdeb41aff47171cb852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.210s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.compute.claims [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Claim successful on node user
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.policy [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5c6f094b0c423ea22b458b0beecb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b9a3c05c7147b88d7814833b87d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Creating image(s)
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:28:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:28:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG nova.policy [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a37cd705cb44c191fe6fad731b4873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e727b9484bb4bdeb41aff47171cb852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:28:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Creating image(s)
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:56 user sudo[84952]: pam_unix(sudo:session): session closed for user root
Nov 03 17:28:56 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Spawned new privsep daemon via rootwrap
Nov 03 17:28:56 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 17:28:56 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 17:28:56 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 03 17:28:56 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84958
Nov 03 17:28:56 user nova-compute[75463]: WARNING oslo_privsep.priv_context [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] privsep daemon already running
Nov 03 17:28:56 user nova-compute[75463]: WARNING oslo_privsep.priv_context [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] privsep daemon already running
Nov 03 17:28:56 user nova-compute[75463]: WARNING oslo_privsep.priv_context [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] privsep daemon already running
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk 1073741824" returned: 0 in 0.054s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.242s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Successfully created port: 2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk 1073741824" returned: 0 in 0.067s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.542s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Cannot resize image /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Ensure instance console log exists: /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Successfully created port: b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Successfully created port: 067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.158s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk 1073741824" returned: 0 in 0.051s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.774s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Cannot resize image /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Ensure instance console log exists: /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.214s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk 1073741824" returned: 0 in 0.055s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Successfully created port: 391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Cannot resize image /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Ensure instance console log exists: /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Cannot resize image /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Ensure instance console log exists: /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:28:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Successfully updated port: 067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquired lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-changed-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Refreshing instance network info cache due to event network-changed-067c14a0-e818-4595-987f-ffe308f00a6f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:28:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] Acquiring lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updating instance_info_cache with network_info: [{"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Releasing lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Instance network_info: |[{"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] Acquired lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Refreshing network info cache for port 067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Start _get_guest_xml network_info=[{"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:00 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:00 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-980164017',display_name='tempest-DeleteServersTestJSON-server-980164017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-980164017',id=1,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01d9d83719b645ecac611cdaec3b8c59',ramdisk_id='',reservation_id='r-482q8s8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-965195714',owner_user_name='tempest-DeleteServersTestJSON-965195714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:53Z,user_data=None,user_id='60c4a5139bae4304aed5c5fddebd9d18',uuid=728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converting VIF {"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.objects.instance [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lazy-loading 'pci_devices' on Instance uuid 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:00 user nova-compute[75463]:   <uuid>728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60</uuid>
Nov 03 17:29:00 user nova-compute[75463]:   <name>instance-00000001</name>
Nov 03 17:29:00 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:00 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:00 user nova-compute[75463]:   <metadata>
Nov 03 17:29:00 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:00 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:name>tempest-DeleteServersTestJSON-server-980164017</nova:name>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:00</nova:creationTime>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:00 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:00 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:user uuid="60c4a5139bae4304aed5c5fddebd9d18">tempest-DeleteServersTestJSON-965195714-project-member</nova:user>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:project uuid="01d9d83719b645ecac611cdaec3b8c59">tempest-DeleteServersTestJSON-965195714</nova:project>
Nov 03 17:29:00 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:00 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:00 user nova-compute[75463]:         <nova:port uuid="067c14a0-e818-4595-987f-ffe308f00a6f">
Nov 03 17:29:00 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:29:00 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:00 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:00 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:00 user nova-compute[75463]:   </metadata>
Nov 03 17:29:00 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:00 user nova-compute[75463]:     <system>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="serial">728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60</entry>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="uuid">728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60</entry>
Nov 03 17:29:00 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:00 user nova-compute[75463]:     </system>
Nov 03 17:29:00 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:00 user nova-compute[75463]:   <os>
Nov 03 17:29:00 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:00 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:00 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:00 user nova-compute[75463]:   </os>
Nov 03 17:29:00 user nova-compute[75463]:   <features>
Nov 03 17:29:00 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:00 user nova-compute[75463]:     <apic/>
Nov 03 17:29:00 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:00 user nova-compute[75463]:   </features>
Nov 03 17:29:00 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:00 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:00 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:00 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:00 user nova-compute[75463]:   </clock>
Nov 03 17:29:00 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:00 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:00 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:00 user nova-compute[75463]:   </cpu>
Nov 03 17:29:00 user nova-compute[75463]:   <devices>
Nov 03 17:29:00 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:00 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:00 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk"/>
Nov 03 17:29:00 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:00 user nova-compute[75463]:     </disk>
Nov 03 17:29:00 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:00 user nova-compute[75463]:       <mac address="fa:16:3e:80:d5:3b"/>
Nov 03 17:29:00 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:00 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:00 user nova-compute[75463]:       <target dev="tap067c14a0-e8"/>
Nov 03 17:29:00 user nova-compute[75463]:     </interface>
Nov 03 17:29:00 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:00 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/console.log" append="off"/>
Nov 03 17:29:00 user nova-compute[75463]:     </serial>
Nov 03 17:29:00 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:00 user nova-compute[75463]:     <video>
Nov 03 17:29:00 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:00 user nova-compute[75463]:     </video>
Nov 03 17:29:00 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:00 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:00 user nova-compute[75463]:     </rng>
Nov 03 17:29:00 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:00 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:00 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:00 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:00 user nova-compute[75463]:   </devices>
Nov 03 17:29:00 user nova-compute[75463]: </domain>
Nov 03 17:29:00 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-980164017',display_name='tempest-DeleteServersTestJSON-server-980164017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-980164017',id=1,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01d9d83719b645ecac611cdaec3b8c59',ramdisk_id='',reservation_id='r-482q8s8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-965195714',owner_user_name='tempest-DeleteServersTestJSON-965195714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:53Z,user_data=None,user_id='60c4a5139bae4304aed5c5fddebd9d18',uuid=728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converting VIF {"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG os_vif [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Created schema index Interface.name {{(pid=75463) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Created schema index Port.name {{(pid=75463) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Created schema index Bridge.name {{(pid=75463) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [POLLOUT] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '661946bf-cdac-5e6d-b9cb-7c3dd44ab094', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:00 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpm9eyt887/privsep.sock']
Nov 03 17:29:00 user sudo[85056]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpm9eyt887/privsep.sock
Nov 03 17:29:00 user sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Successfully updated port: 2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-changed-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Refreshing instance network info cache due to event network-changed-2ac39514-25cc-4625-95e7-4b440a2a51b2. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updated VIF entry in instance network info cache for port 067c14a0-e818-4595-987f-ffe308f00a6f. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updating instance_info_cache with network_info: [{"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6c3c0bc9-0b62-4baa-870c-70f1046ed7dc req-12f67d84-bb99-41da-98fd-1b37866b4692 service nova] Releasing lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Successfully updated port: b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-changed-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Refreshing instance network info cache due to event network-changed-b2fab86b-cc7b-4661-8776-e89a08742f23. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Successfully updated port: 391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:02 user sudo[85056]: pam_unix(sudo:session): session closed for user root
Nov 03 17:29:02 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Spawned new privsep daemon via rootwrap
Nov 03 17:29:02 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 17:29:02 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 17:29:02 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 03 17:29:02 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85064
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance network_info: |[{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Refreshing network info cache for port 2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start _get_guest_xml network_info=[{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457135785',display_name='tempest-ServerRescueNegativeTestJSON-server-1457135785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457135785',id=4,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-zuajlzo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:56Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=bd9327c9-ae8e-424e-ac57-026284f57f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:02 user nova-compute[75463]:   <uuid>bd9327c9-ae8e-424e-ac57-026284f57f85</uuid>
Nov 03 17:29:02 user nova-compute[75463]:   <name>instance-00000004</name>
Nov 03 17:29:02 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:02 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:02 user nova-compute[75463]:   <metadata>
Nov 03 17:29:02 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:02 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457135785</nova:name>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:02</nova:creationTime>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:02 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:02 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:29:02 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:02 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:02 user nova-compute[75463]:         <nova:port uuid="2ac39514-25cc-4625-95e7-4b440a2a51b2">
Nov 03 17:29:02 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:29:02 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:02 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:02 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:02 user nova-compute[75463]:   </metadata>
Nov 03 17:29:02 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:02 user nova-compute[75463]:     <system>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="serial">bd9327c9-ae8e-424e-ac57-026284f57f85</entry>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="uuid">bd9327c9-ae8e-424e-ac57-026284f57f85</entry>
Nov 03 17:29:02 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:02 user nova-compute[75463]:     </system>
Nov 03 17:29:02 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:02 user nova-compute[75463]:   <os>
Nov 03 17:29:02 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:02 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:02 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:02 user nova-compute[75463]:   </os>
Nov 03 17:29:02 user nova-compute[75463]:   <features>
Nov 03 17:29:02 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:02 user nova-compute[75463]:     <apic/>
Nov 03 17:29:02 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:02 user nova-compute[75463]:   </features>
Nov 03 17:29:02 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:02 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:02 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:02 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:02 user nova-compute[75463]:   </clock>
Nov 03 17:29:02 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:02 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:02 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:02 user nova-compute[75463]:   </cpu>
Nov 03 17:29:02 user nova-compute[75463]:   <devices>
Nov 03 17:29:02 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:02 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:02 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk"/>
Nov 03 17:29:02 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:02 user nova-compute[75463]:     </disk>
Nov 03 17:29:02 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:02 user nova-compute[75463]:       <mac address="fa:16:3e:9c:12:72"/>
Nov 03 17:29:02 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:02 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:02 user nova-compute[75463]:       <target dev="tap2ac39514-25"/>
Nov 03 17:29:02 user nova-compute[75463]:     </interface>
Nov 03 17:29:02 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:02 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/console.log" append="off"/>
Nov 03 17:29:02 user nova-compute[75463]:     </serial>
Nov 03 17:29:02 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:02 user nova-compute[75463]:     <video>
Nov 03 17:29:02 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:02 user nova-compute[75463]:     </video>
Nov 03 17:29:02 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:02 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:02 user nova-compute[75463]:     </rng>
Nov 03 17:29:02 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:02 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:02 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:02 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:02 user nova-compute[75463]:   </devices>
Nov 03 17:29:02 user nova-compute[75463]: </domain>
Nov 03 17:29:02 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457135785',display_name='tempest-ServerRescueNegativeTestJSON-server-1457135785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457135785',id=4,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-zuajlzo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:56Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=bd9327c9-ae8e-424e-ac57-026284f57f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG os_vif [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17c09a06-a8bb-5f4d-a5c3-f8d2a57bbd78', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac39514-25, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ac39514-25, col_values=(('qos', UUID('302b01c8-747b-475a-99fc-c7550f072664')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ac39514-25, col_values=(('external_ids', {'iface-id': '2ac39514-25cc-4625-95e7-4b440a2a51b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:12:72', 'vm-uuid': 'bd9327c9-ae8e-424e-ac57-026284f57f85'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: INFO os_vif [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25')
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067c14a0-e8, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap067c14a0-e8, col_values=(('qos', UUID('6595ec82-d6f5-4c5d-9d68-304667aeaf49')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap067c14a0-e8, col_values=(('external_ids', {'iface-id': '067c14a0-e818-4595-987f-ffe308f00a6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:d5:3b', 'vm-uuid': '728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:02 user nova-compute[75463]: INFO os_vif [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8')
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:9c:12:72, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] No VIF found with MAC fa:16:3e:80:d5:3b, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance network_info: |[{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Refreshing network info cache for port b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start _get_guest_xml network_info=[{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425014350',display_name='tempest-ServerRescueNegativeTestJSON-server-1425014350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425014350',id=3,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-dd0gp0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:55Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=c79148db-7d6f-4a58-8e75-ead5b154c335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:03 user nova-compute[75463]:   <uuid>c79148db-7d6f-4a58-8e75-ead5b154c335</uuid>
Nov 03 17:29:03 user nova-compute[75463]:   <name>instance-00000003</name>
Nov 03 17:29:03 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:03 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:03 user nova-compute[75463]:   <metadata>
Nov 03 17:29:03 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:03 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1425014350</nova:name>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:03</nova:creationTime>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:03 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:03 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:29:03 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:03 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:03 user nova-compute[75463]:         <nova:port uuid="b2fab86b-cc7b-4661-8776-e89a08742f23">
Nov 03 17:29:03 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:29:03 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:03 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:03 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:03 user nova-compute[75463]:   </metadata>
Nov 03 17:29:03 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:03 user nova-compute[75463]:     <system>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="serial">c79148db-7d6f-4a58-8e75-ead5b154c335</entry>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="uuid">c79148db-7d6f-4a58-8e75-ead5b154c335</entry>
Nov 03 17:29:03 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:03 user nova-compute[75463]:     </system>
Nov 03 17:29:03 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:03 user nova-compute[75463]:   <os>
Nov 03 17:29:03 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:03 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:03 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:03 user nova-compute[75463]:   </os>
Nov 03 17:29:03 user nova-compute[75463]:   <features>
Nov 03 17:29:03 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:03 user nova-compute[75463]:     <apic/>
Nov 03 17:29:03 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:03 user nova-compute[75463]:   </features>
Nov 03 17:29:03 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:03 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:03 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:03 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:03 user nova-compute[75463]:   </clock>
Nov 03 17:29:03 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:03 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:03 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:03 user nova-compute[75463]:   </cpu>
Nov 03 17:29:03 user nova-compute[75463]:   <devices>
Nov 03 17:29:03 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:03 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:03 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk"/>
Nov 03 17:29:03 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:03 user nova-compute[75463]:     </disk>
Nov 03 17:29:03 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:03 user nova-compute[75463]:       <mac address="fa:16:3e:81:a5:56"/>
Nov 03 17:29:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:03 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:03 user nova-compute[75463]:       <target dev="tapb2fab86b-cc"/>
Nov 03 17:29:03 user nova-compute[75463]:     </interface>
Nov 03 17:29:03 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:03 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/console.log" append="off"/>
Nov 03 17:29:03 user nova-compute[75463]:     </serial>
Nov 03 17:29:03 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:03 user nova-compute[75463]:     <video>
Nov 03 17:29:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:03 user nova-compute[75463]:     </video>
Nov 03 17:29:03 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:03 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:03 user nova-compute[75463]:     </rng>
Nov 03 17:29:03 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:03 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:03 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:03 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:03 user nova-compute[75463]:   </devices>
Nov 03 17:29:03 user nova-compute[75463]: </domain>
Nov 03 17:29:03 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425014350',display_name='tempest-ServerRescueNegativeTestJSON-server-1425014350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425014350',id=3,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-dd0gp0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:55Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=c79148db-7d6f-4a58-8e75-ead5b154c335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG os_vif [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2202726-207e-55cb-985c-b6f72f95f929', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2fab86b-cc, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2fab86b-cc, col_values=(('qos', UUID('9c87bf71-476a-49ae-85e7-33b4089bea3e')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2fab86b-cc, col_values=(('external_ids', {'iface-id': 'b2fab86b-cc7b-4661-8776-e89a08742f23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:a5:56', 'vm-uuid': 'c79148db-7d6f-4a58-8e75-ead5b154c335'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:03 user nova-compute[75463]: INFO os_vif [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc')
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:81:a5:56, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Instance network_info: |[{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Start _get_guest_xml network_info=[{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935548463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935548463',id=2,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-jpkl0udj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:56Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=4bae3d43-2efe-474a-b57c-311b090b7ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bae3d43-2efe-474a-b57c-311b090b7ba1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:04 user nova-compute[75463]:   <uuid>4bae3d43-2efe-474a-b57c-311b090b7ba1</uuid>
Nov 03 17:29:04 user nova-compute[75463]:   <name>instance-00000002</name>
Nov 03 17:29:04 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:04 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:04 user nova-compute[75463]:   <metadata>
Nov 03 17:29:04 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:04 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1935548463</nova:name>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:03</nova:creationTime>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:04 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:04 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:user uuid="bd5c6f094b0c423ea22b458b0beecb15">tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member</nova:user>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:project uuid="06b9a3c05c7147b88d7814833b87d157">tempest-ServerBootFromVolumeStableRescueTest-2042988048</nova:project>
Nov 03 17:29:04 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:04 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:04 user nova-compute[75463]:         <nova:port uuid="391382d2-159d-488b-b035-5435c0de9b94">
Nov 03 17:29:04 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:29:04 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:04 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:04 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:04 user nova-compute[75463]:   </metadata>
Nov 03 17:29:04 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:04 user nova-compute[75463]:     <system>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="serial">4bae3d43-2efe-474a-b57c-311b090b7ba1</entry>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="uuid">4bae3d43-2efe-474a-b57c-311b090b7ba1</entry>
Nov 03 17:29:04 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:04 user nova-compute[75463]:     </system>
Nov 03 17:29:04 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:04 user nova-compute[75463]:   <os>
Nov 03 17:29:04 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:04 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:04 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:04 user nova-compute[75463]:   </os>
Nov 03 17:29:04 user nova-compute[75463]:   <features>
Nov 03 17:29:04 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:04 user nova-compute[75463]:     <apic/>
Nov 03 17:29:04 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:04 user nova-compute[75463]:   </features>
Nov 03 17:29:04 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:04 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:04 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:04 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:04 user nova-compute[75463]:   </clock>
Nov 03 17:29:04 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:04 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:04 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:04 user nova-compute[75463]:   </cpu>
Nov 03 17:29:04 user nova-compute[75463]:   <devices>
Nov 03 17:29:04 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:04 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:04 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk"/>
Nov 03 17:29:04 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:04 user nova-compute[75463]:     </disk>
Nov 03 17:29:04 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:04 user nova-compute[75463]:       <mac address="fa:16:3e:d0:b4:24"/>
Nov 03 17:29:04 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:04 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:04 user nova-compute[75463]:       <target dev="tap391382d2-15"/>
Nov 03 17:29:04 user nova-compute[75463]:     </interface>
Nov 03 17:29:04 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:04 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/console.log" append="off"/>
Nov 03 17:29:04 user nova-compute[75463]:     </serial>
Nov 03 17:29:04 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:04 user nova-compute[75463]:     <video>
Nov 03 17:29:04 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:04 user nova-compute[75463]:     </video>
Nov 03 17:29:04 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:04 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:04 user nova-compute[75463]:     </rng>
Nov 03 17:29:04 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:04 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:04 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:04 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:04 user nova-compute[75463]:   </devices>
Nov 03 17:29:04 user nova-compute[75463]: </domain>
Nov 03 17:29:04 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935548463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935548463',id=2,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-jpkl0udj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:28:56Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=4bae3d43-2efe-474a-b57c-311b090b7ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG os_vif [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99bfb5e1-f184-5869-bd87-4b6f14be1358', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391382d2-15, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391382d2-15, col_values=(('qos', UUID('fd9607fe-0fbd-46a4-8420-07fe704dc379')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391382d2-15, col_values=(('external_ids', {'iface-id': '391382d2-159d-488b-b035-5435c0de9b94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b4:24', 'vm-uuid': '4bae3d43-2efe-474a-b57c-311b090b7ba1'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:04 user nova-compute[75463]: INFO os_vif [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15')
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No VIF found with MAC fa:16:3e:d0:b4:24, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-changed-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Refreshing instance network info cache due to event network-changed-391382d2-159d-488b-b035-5435c0de9b94. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] Acquiring lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] Acquired lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Refreshing network info cache for port 391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updated VIF entry in instance network info cache for port b2fab86b-cc7b-4661-8776-e89a08742f23. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70999357-4169-4d5f-807b-6dd78c3a07e3 req-8b959d98-e588-48b9-94f2-f215d05149f6 service nova] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updated VIF entry in instance network info cache for port 2ac39514-25cc-4625-95e7-4b440a2a51b2. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-109068b0-b0ba-4dd1-8553-43465f094b08 req-a8296ee2-ee97-49f3-956b-0f3a14c7e6fa service nova] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updated VIF entry in instance network info cache for port 391382d2-159d-488b-b035-5435c0de9b94. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-33d95adf-e5d6-4a66-a55f-300c4e92fccc req-9501179b-47e3-46a3-abac-974f3537706b service nova] Releasing lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:07 user nova-compute[75463]: INFO nova.compute.claims [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Claim successful on node user
Nov 03 17:29:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Creating image(s)
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "/opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "/opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "/opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.policy [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88e751e1d904465b8437c94c71a9ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08bff16abf848b9b2c427f79975327f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk 1073741824" returned: 0 in 0.060s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Cannot resize image /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Ensure instance console log exists: /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Successfully created port: 01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:10 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance spawned successfully.
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Took 15.01 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.compute.manager [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Took 15.89 seconds to build instance.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c0ade595-2af3-4f80-a9f3-2bc92548d541 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.078s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Instance spawned successfully.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance spawned successfully.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Took 18.39 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.compute.manager [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Took 19.83 seconds to build instance.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8d4d6a11-6d26-4fc4-88ec-0ef6e0909a8d tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.059s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:11 user nova-compute[75463]: INFO nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Took 16.44 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Instance spawned successfully.
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:12 user nova-compute[75463]: INFO nova.compute.manager [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Took 17.60 seconds to build instance.
Nov 03 17:29:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d5b672d9-1255-41b6-a06c-dd6a9a48a947 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.758s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:12 user nova-compute[75463]: INFO nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Took 16.34 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:12 user nova-compute[75463]: INFO nova.compute.manager [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Took 17.91 seconds to build instance.
Nov 03 17:29:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a520e95-ab33-45aa-bbc3-caebb4113b13 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.095s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Successfully updated port: 01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquired lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-changed-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Refreshing instance network info cache due to event network-changed-01cbe183-9bb3-46fa-9c2a-e32d591c6c81. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] Acquiring lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating instance_info_cache with network_info: [{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Releasing lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Instance network_info: |[{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] Acquired lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.neutron [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Refreshing network info cache for port 01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Start _get_guest_xml network_info=[{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1811969193',display_name='tempest-ServerStableDeviceRescueTest-server-1811969193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1811969193',id=5,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzrDkYppvizaRQZYa8savARfG3q+k+RlWtGy+NNJEV2KPyY2k5xVFgsBGDN1rcAs43IKP0rapcNTPEABmdLmigsWADGRearvhdJGswCeaqsLIuJon9qZIbEQjyhxFb2pA==',key_name='tempest-keypair-1415038898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08bff16abf848b9b2c427f79975327f',ramdisk_id='',reservation_id='r-n8eu45ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1512447065',owner_user_name='tempest-ServerStableDeviceRescueTest-1512447065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e751e1d904465b8437c94c71a9ab80',uuid=8068fdfb-ac16-4213-8152-885a91e37616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converting VIF {"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lazy-loading 'pci_devices' on Instance uuid 8068fdfb-ac16-4213-8152-885a91e37616 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:14 user nova-compute[75463]:   <uuid>8068fdfb-ac16-4213-8152-885a91e37616</uuid>
Nov 03 17:29:14 user nova-compute[75463]:   <name>instance-00000005</name>
Nov 03 17:29:14 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:14 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:14 user nova-compute[75463]:   <metadata>
Nov 03 17:29:14 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:14 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1811969193</nova:name>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:14</nova:creationTime>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:14 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:14 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:user uuid="88e751e1d904465b8437c94c71a9ab80">tempest-ServerStableDeviceRescueTest-1512447065-project-member</nova:user>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:project uuid="c08bff16abf848b9b2c427f79975327f">tempest-ServerStableDeviceRescueTest-1512447065</nova:project>
Nov 03 17:29:14 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:14 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:14 user nova-compute[75463]:         <nova:port uuid="01cbe183-9bb3-46fa-9c2a-e32d591c6c81">
Nov 03 17:29:14 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:29:14 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:14 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:14 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:14 user nova-compute[75463]:   </metadata>
Nov 03 17:29:14 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:14 user nova-compute[75463]:     <system>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="serial">8068fdfb-ac16-4213-8152-885a91e37616</entry>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="uuid">8068fdfb-ac16-4213-8152-885a91e37616</entry>
Nov 03 17:29:14 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:14 user nova-compute[75463]:     </system>
Nov 03 17:29:14 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:14 user nova-compute[75463]:   <os>
Nov 03 17:29:14 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:14 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:14 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:14 user nova-compute[75463]:   </os>
Nov 03 17:29:14 user nova-compute[75463]:   <features>
Nov 03 17:29:14 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:14 user nova-compute[75463]:     <apic/>
Nov 03 17:29:14 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:14 user nova-compute[75463]:   </features>
Nov 03 17:29:14 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:14 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:14 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:14 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:14 user nova-compute[75463]:   </clock>
Nov 03 17:29:14 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:14 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:14 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:14 user nova-compute[75463]:   </cpu>
Nov 03 17:29:14 user nova-compute[75463]:   <devices>
Nov 03 17:29:14 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:14 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:14 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk"/>
Nov 03 17:29:14 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:14 user nova-compute[75463]:     </disk>
Nov 03 17:29:14 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:14 user nova-compute[75463]:       <mac address="fa:16:3e:bc:e2:16"/>
Nov 03 17:29:14 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:14 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:14 user nova-compute[75463]:       <target dev="tap01cbe183-9b"/>
Nov 03 17:29:14 user nova-compute[75463]:     </interface>
Nov 03 17:29:14 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:14 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/console.log" append="off"/>
Nov 03 17:29:14 user nova-compute[75463]:     </serial>
Nov 03 17:29:14 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:14 user nova-compute[75463]:     <video>
Nov 03 17:29:14 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:14 user nova-compute[75463]:     </video>
Nov 03 17:29:14 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:14 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:14 user nova-compute[75463]:     </rng>
Nov 03 17:29:14 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:14 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:14 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:14 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:14 user nova-compute[75463]:   </devices>
Nov 03 17:29:14 user nova-compute[75463]: </domain>
Nov 03 17:29:14 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1811969193',display_name='tempest-ServerStableDeviceRescueTest-server-1811969193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1811969193',id=5,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzrDkYppvizaRQZYa8savARfG3q+k+RlWtGy+NNJEV2KPyY2k5xVFgsBGDN1rcAs43IKP0rapcNTPEABmdLmigsWADGRearvhdJGswCeaqsLIuJon9qZIbEQjyhxFb2pA==',key_name='tempest-keypair-1415038898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08bff16abf848b9b2c427f79975327f',ramdisk_id='',reservation_id='r-n8eu45ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1512447065',owner_user_name='tempest-ServerStableDeviceRescueTest-1512447065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e751e1d904465b8437c94c71a9ab80',uuid=8068fdfb-ac16-4213-8152-885a91e37616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converting VIF {"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG os_vif [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ade2cbc6-ba85-5fc6-8b00-7df396eb9961', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01cbe183-9b, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01cbe183-9b, col_values=(('qos', UUID('eb1ec27e-9915-4ee3-8131-94620ddf45a4')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01cbe183-9b, col_values=(('external_ids', {'iface-id': '01cbe183-9bb3-46fa-9c2a-e32d591c6c81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:e2:16', 'vm-uuid': '8068fdfb-ac16-4213-8152-885a91e37616'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:14 user nova-compute[75463]: INFO os_vif [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b')
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] No VIF found with MAC fa:16:3e:bc:e2:16, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updated VIF entry in instance network info cache for port 01cbe183-9bb3-46fa-9c2a-e32d591c6c81. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating instance_info_cache with network_info: [{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8234c26f-5b80-46a1-9589-f966e1b77a93 req-ce904b40-0abd-409d-9452-97875558f794 service nova] Releasing lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:19 user nova-compute[75463]: WARNING nova.compute.manager [req-0930c2fa-8a50-4a30-82c7-2de9da8cf491 req-ff6a837d-a958-4dc0-af64-ed41a2687a09 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state None.
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Instance spawned successfully.
Nov 03 17:29:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:20 user nova-compute[75463]: INFO nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Took 12.14 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:20 user nova-compute[75463]: INFO nova.compute.manager [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Took 13.12 seconds to build instance.
Nov 03 17:29:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-22eff3df-3058-40aa-9ff5-c5b1bd8aa934 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.249s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:21 user nova-compute[75463]: WARNING nova.compute.manager [req-48b5923a-c88d-46fc-8b3c-eabaeb4a89c6 req-9472709f-13e8-4354-be3f-69d4d99adaf5 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state None.
Nov 03 17:29:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:24 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:24 user nova-compute[75463]: INFO nova.compute.claims [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Claim successful on node user
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.policy [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7015a1cbbd024518b9590d2561dc02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f7989faf6b4c08b25287cd6fb74ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Creating image(s)
Nov 03 17:29:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.014s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.308s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.246s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk 1073741824" returned: 0 in 0.096s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:26 user nova-compute[75463]: INFO nova.compute.claims [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Claim successful on node user
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Cannot resize image /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Ensure instance console log exists: /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Successfully created port: 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.706s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:27 user nova-compute[75463]: INFO nova.compute.claims [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Claim successful on node user
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.policy [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71d57ec5de304ecdab633cfc23da34d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdb43ab35d14b9ca7830846c0588e58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Creating image(s)
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "e3ca29a958088bb8be984249a0389d07a6b149c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "e3ca29a958088bb8be984249a0389d07a6b149c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] No waiting events found dispatching network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:28 user nova-compute[75463]: WARNING nova.compute.manager [req-7b242678-c514-47ac-8c98-612abec76c8c req-deb33ff8-b396-47e3-ab25-308515d43bc3 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received unexpected event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 for instance with vm_state active and task_state None.
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.090s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.part --force-share --output=json" returned: 0 in 0.292s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.virt.images [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] f8e175e5-62ac-4cc6-8c0a-09fd099fabf7 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.part /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Successfully created port: 00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Successfully updated port: 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.part /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.converted" returned: 0 in 0.232s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.policy [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2991422c844b4064bb476827300e4119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f4c5d074ef4609b31b26e88ed3bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Creating image(s)
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "/opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "/opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "e3ca29a958088bb8be984249a0389d07a6b149c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.427s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.300s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json" returned: 0 in 0.283s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "e3ca29a958088bb8be984249a0389d07a6b149c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "e3ca29a958088bb8be984249a0389d07a6b149c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.271s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json" returned: 0 in 0.240s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3,backing_fmt=raw /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk 1073741824" returned: 0 in 0.125s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.414s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3,backing_fmt=raw /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk 1073741824" returned: 0 in 0.122s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "e3ca29a958088bb8be984249a0389d07a6b149c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.241s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Instance network_info: |[{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Start _get_guest_xml network_info=[{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3 --force-share --output=json" returned: 0 in 0.281s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:29 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:29 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.objects.instance [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'pci_devices' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Successfully updated port: 00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-changed-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Refreshing instance network info cache due to event network-changed-00db5cb6-0806-4249-ad16-50f5d22750b0. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] Acquiring lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] Acquired lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:29 user nova-compute[75463]: DEBUG nova.network.neutron [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Refreshing network info cache for port 00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:30 user nova-compute[75463]:   <uuid>3394c83b-9dc5-44a5-8af9-122da4f80233</uuid>
Nov 03 17:29:30 user nova-compute[75463]:   <name>instance-00000006</name>
Nov 03 17:29:30 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:30 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:30 user nova-compute[75463]:   <metadata>
Nov 03 17:29:30 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:30 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:29</nova:creationTime>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:30 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:30 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:29:30 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:30 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:30 user nova-compute[75463]:         <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:29:30 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:29:30 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:30 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:30 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:30 user nova-compute[75463]:   </metadata>
Nov 03 17:29:30 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:30 user nova-compute[75463]:     <system>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="serial">3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="uuid">3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:29:30 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:30 user nova-compute[75463]:     </system>
Nov 03 17:29:30 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:30 user nova-compute[75463]:   <os>
Nov 03 17:29:30 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:30 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:30 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:30 user nova-compute[75463]:   </os>
Nov 03 17:29:30 user nova-compute[75463]:   <features>
Nov 03 17:29:30 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:30 user nova-compute[75463]:     <apic/>
Nov 03 17:29:30 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:30 user nova-compute[75463]:   </features>
Nov 03 17:29:30 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:30 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:30 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:30 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:30 user nova-compute[75463]:   </clock>
Nov 03 17:29:30 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:30 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:30 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:30 user nova-compute[75463]:   </cpu>
Nov 03 17:29:30 user nova-compute[75463]:   <devices>
Nov 03 17:29:30 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:30 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:30 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk"/>
Nov 03 17:29:30 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:30 user nova-compute[75463]:     </disk>
Nov 03 17:29:30 user nova-compute[75463]:     <disk type="file" device="cdrom">
Nov 03 17:29:30 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 17:29:30 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config"/>
Nov 03 17:29:30 user nova-compute[75463]:       <target dev="hda" bus="ide"/>
Nov 03 17:29:30 user nova-compute[75463]:     </disk>
Nov 03 17:29:30 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:30 user nova-compute[75463]:       <mac address="fa:16:3e:d6:09:cb"/>
Nov 03 17:29:30 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:30 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:30 user nova-compute[75463]:       <target dev="tap7a83cf1d-0d"/>
Nov 03 17:29:30 user nova-compute[75463]:     </interface>
Nov 03 17:29:30 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:30 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log" append="off"/>
Nov 03 17:29:30 user nova-compute[75463]:     </serial>
Nov 03 17:29:30 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:30 user nova-compute[75463]:     <video>
Nov 03 17:29:30 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:30 user nova-compute[75463]:     </video>
Nov 03 17:29:30 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:30 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:30 user nova-compute[75463]:     </rng>
Nov 03 17:29:30 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:30 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:30 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:30 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:30 user nova-compute[75463]:   </devices>
Nov 03 17:29:30 user nova-compute[75463]: </domain>
Nov 03 17:29:30 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG os_vif [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f70a0da2-ccb2-529e-aae6-b92f450f4772', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Cannot resize image /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Ensure instance console log exists: /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a83cf1d-0d, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a83cf1d-0d, col_values=(('qos', UUID('390b0944-3328-4cab-8c8a-c6ef16a8f908')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a83cf1d-0d, col_values=(('external_ids', {'iface-id': '7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:09:cb', 'vm-uuid': '3394c83b-9dc5-44a5-8af9-122da4f80233'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:30 user nova-compute[75463]: INFO os_vif [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d')
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] No waiting events found dispatching network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:30 user nova-compute[75463]: WARNING nova.compute.manager [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received unexpected event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 for instance with vm_state active and task_state None.
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-changed-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing instance network info cache due to event network-changed-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing network info cache for port 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Cannot resize image /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Ensure instance console log exists: /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name hda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No VIF found with MAC fa:16:3e:d6:09:cb, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Using config drive
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Successfully created port: b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-458fe023-ea5b-4da9-a45f-fabee412f50e req-425b9215-c1c3-484f-8e77-34d96ecabf70 service nova] Releasing lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquired lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:30 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updated VIF entry in instance network info cache for port 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a9bd2ac-078a-4a82-b64e-8c932ecb4e35 req-ed426ddf-d846-4a38-9887-8fabcd0a7d4b service nova] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Creating config drive at /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config
Nov 03 17:29:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppso9t4ik {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating instance_info_cache with network_info: [{"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppso9t4ik" returned: 0 in 0.058s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Releasing lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance network_info: |[{"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Start _get_guest_xml network_info=[{"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:29:15Z,direct_url=<?>,disk_format='qcow2',id=f8e175e5-62ac-4cc6-8c0a-09fd099fabf7,min_disk=0,min_ram=0,name='',owner='497ec6cde64d43418132e90a41b40af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:29:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'encrypted': False, 'image_id': 'f8e175e5-62ac-4cc6-8c0a-09fd099fabf7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:29:15Z,direct_url=<?>,disk_format='qcow2',id=f8e175e5-62ac-4cc6-8c0a-09fd099fabf7,min_disk=0,min_ram=0,name='',owner='497ec6cde64d43418132e90a41b40af5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:29:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-459774150',display_name='tempest-AttachSCSIVolumeTestJSON-server-459774150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-459774150',id=7,image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIt4sRxVuMADUMKNN+j5OW1POeeZ+GKf28Py7Ef1gbIHT64i1X/N8ZRiCgUTHoqHExxje6AX+oxErx9j46M+PYZjZSDD9tgRel+BE7/oCzDWigrhm3xFJNOkedmLjKtxw==',key_name='tempest-keypair-1268836043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acdb43ab35d14b9ca7830846c0588e58',ramdisk_id='',reservation_id='r-ubfwb9vo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1770578812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1770578812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71d57ec5de304ecdab633cfc23da34d5',uuid=26968122-309b-4eb1-ad6e-bddd5e4639a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converting VIF {"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lazy-loading 'pci_devices' on Instance uuid 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:31 user nova-compute[75463]:   <uuid>26968122-309b-4eb1-ad6e-bddd5e4639a6</uuid>
Nov 03 17:29:31 user nova-compute[75463]:   <name>instance-00000007</name>
Nov 03 17:29:31 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:31 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:31 user nova-compute[75463]:   <metadata>
Nov 03 17:29:31 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:31 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-459774150</nova:name>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:31</nova:creationTime>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:31 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:31 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:user uuid="71d57ec5de304ecdab633cfc23da34d5">tempest-AttachSCSIVolumeTestJSON-1770578812-project-member</nova:user>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:project uuid="acdb43ab35d14b9ca7830846c0588e58">tempest-AttachSCSIVolumeTestJSON-1770578812</nova:project>
Nov 03 17:29:31 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:root type="image" uuid="f8e175e5-62ac-4cc6-8c0a-09fd099fabf7"/>
Nov 03 17:29:31 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:31 user nova-compute[75463]:         <nova:port uuid="00db5cb6-0806-4249-ad16-50f5d22750b0">
Nov 03 17:29:31 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:29:31 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:31 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:31 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:31 user nova-compute[75463]:   </metadata>
Nov 03 17:29:31 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:31 user nova-compute[75463]:     <system>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="serial">26968122-309b-4eb1-ad6e-bddd5e4639a6</entry>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="uuid">26968122-309b-4eb1-ad6e-bddd5e4639a6</entry>
Nov 03 17:29:31 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:31 user nova-compute[75463]:     </system>
Nov 03 17:29:31 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:31 user nova-compute[75463]:   <os>
Nov 03 17:29:31 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:31 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:31 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:31 user nova-compute[75463]:   </os>
Nov 03 17:29:31 user nova-compute[75463]:   <features>
Nov 03 17:29:31 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:31 user nova-compute[75463]:     <apic/>
Nov 03 17:29:31 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:31 user nova-compute[75463]:   </features>
Nov 03 17:29:31 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:31 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:31 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:31 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:31 user nova-compute[75463]:   </clock>
Nov 03 17:29:31 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:31 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:31 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:31 user nova-compute[75463]:   </cpu>
Nov 03 17:29:31 user nova-compute[75463]:   <devices>
Nov 03 17:29:31 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:31 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:31 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk"/>
Nov 03 17:29:31 user nova-compute[75463]:       <target dev="sda" bus="scsi"/>
Nov 03 17:29:31 user nova-compute[75463]:       <address type="drive" controller="0" unit="0"/>
Nov 03 17:29:31 user nova-compute[75463]:     </disk>
Nov 03 17:29:31 user nova-compute[75463]:     <disk type="file" device="cdrom">
Nov 03 17:29:31 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 17:29:31 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.config"/>
Nov 03 17:29:31 user nova-compute[75463]:       <target dev="sdb" bus="scsi"/>
Nov 03 17:29:31 user nova-compute[75463]:       <address type="drive" controller="0" unit="1"/>
Nov 03 17:29:31 user nova-compute[75463]:     </disk>
Nov 03 17:29:31 user nova-compute[75463]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 03 17:29:31 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:31 user nova-compute[75463]:       <mac address="fa:16:3e:af:0c:0d"/>
Nov 03 17:29:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:31 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:31 user nova-compute[75463]:       <target dev="tap00db5cb6-08"/>
Nov 03 17:29:31 user nova-compute[75463]:     </interface>
Nov 03 17:29:31 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:31 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/console.log" append="off"/>
Nov 03 17:29:31 user nova-compute[75463]:     </serial>
Nov 03 17:29:31 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:31 user nova-compute[75463]:     <video>
Nov 03 17:29:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:31 user nova-compute[75463]:     </video>
Nov 03 17:29:31 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:31 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:31 user nova-compute[75463]:     </rng>
Nov 03 17:29:31 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:31 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:31 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:31 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:31 user nova-compute[75463]:   </devices>
Nov 03 17:29:31 user nova-compute[75463]: </domain>
Nov 03 17:29:31 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-459774150',display_name='tempest-AttachSCSIVolumeTestJSON-server-459774150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-459774150',id=7,image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIt4sRxVuMADUMKNN+j5OW1POeeZ+GKf28Py7Ef1gbIHT64i1X/N8ZRiCgUTHoqHExxje6AX+oxErx9j46M+PYZjZSDD9tgRel+BE7/oCzDWigrhm3xFJNOkedmLjKtxw==',key_name='tempest-keypair-1268836043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acdb43ab35d14b9ca7830846c0588e58',ramdisk_id='',reservation_id='r-ubfwb9vo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1770578812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1770578812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71d57ec5de304ecdab633cfc23da34d5',uuid=26968122-309b-4eb1-ad6e-bddd5e4639a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converting VIF {"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG os_vif [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba92cc69-65b3-5d52-b185-80c9d2798066', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00db5cb6-08, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00db5cb6-08, col_values=(('qos', UUID('b4495c3e-c00e-43c0-802b-edb478e3f7a7')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00db5cb6-08, col_values=(('external_ids', {'iface-id': '00db5cb6-0806-4249-ad16-50f5d22750b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:0c:0d', 'vm-uuid': '26968122-309b-4eb1-ad6e-bddd5e4639a6'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:31 user nova-compute[75463]: INFO os_vif [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08')
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No BDM found with device name sda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No VIF found with MAC fa:16:3e:af:0c:0d, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Using config drive
Nov 03 17:29:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Creating config drive at /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.config
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmxlkapxd {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Successfully updated port: b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquired lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmxlkapxd" returned: 0 in 0.081s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-changed-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Refreshing instance network info cache due to event network-changed-b8a319c0-e940-4822-aee7-cb026cad6811. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] Acquiring lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating instance_info_cache with network_info: [{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Releasing lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Instance network_info: |[{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] Acquired lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.neutron [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Refreshing network info cache for port b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Start _get_guest_xml network_info=[{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:32 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:32 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-474918975',display_name='tempest-VolumesAdminNegativeTest-server-474918975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-474918975',id=8,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM2TlN7BaLGgkjjDs+Sx1gXHBztlCLpMMgmDkIsma6BpbHiR1l2L86zc7OuWOGBLEXn7bNQfFsX3seflgA5zED8k8flLWnHBJwPTHyPmJOzqm2SFgU2cP4y45NX/tweuw==',key_name='tempest-keypair-1050106444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-e8hv6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991422c844b4064bb476827300e4119',uuid=8c04ed34-af8a-49b9-99ce-3bb48ef8584b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:32 user nova-compute[75463]:   <uuid>8c04ed34-af8a-49b9-99ce-3bb48ef8584b</uuid>
Nov 03 17:29:32 user nova-compute[75463]:   <name>instance-00000008</name>
Nov 03 17:29:32 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:32 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:32 user nova-compute[75463]:   <metadata>
Nov 03 17:29:32 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:32 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:name>tempest-VolumesAdminNegativeTest-server-474918975</nova:name>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:32</nova:creationTime>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:32 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:32 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:user uuid="2991422c844b4064bb476827300e4119">tempest-VolumesAdminNegativeTest-1183184812-project-member</nova:user>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:project uuid="51f4c5d074ef4609b31b26e88ed3bf1f">tempest-VolumesAdminNegativeTest-1183184812</nova:project>
Nov 03 17:29:32 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:32 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:32 user nova-compute[75463]:         <nova:port uuid="b8a319c0-e940-4822-aee7-cb026cad6811">
Nov 03 17:29:32 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 17:29:32 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:32 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:32 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:32 user nova-compute[75463]:   </metadata>
Nov 03 17:29:32 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:32 user nova-compute[75463]:     <system>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="serial">8c04ed34-af8a-49b9-99ce-3bb48ef8584b</entry>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="uuid">8c04ed34-af8a-49b9-99ce-3bb48ef8584b</entry>
Nov 03 17:29:32 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:32 user nova-compute[75463]:     </system>
Nov 03 17:29:32 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:32 user nova-compute[75463]:   <os>
Nov 03 17:29:32 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:32 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:32 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:32 user nova-compute[75463]:   </os>
Nov 03 17:29:32 user nova-compute[75463]:   <features>
Nov 03 17:29:32 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:32 user nova-compute[75463]:     <apic/>
Nov 03 17:29:32 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:32 user nova-compute[75463]:   </features>
Nov 03 17:29:32 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:32 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:32 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:32 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:32 user nova-compute[75463]:   </clock>
Nov 03 17:29:32 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:32 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:32 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:32 user nova-compute[75463]:   </cpu>
Nov 03 17:29:32 user nova-compute[75463]:   <devices>
Nov 03 17:29:32 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:32 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:32 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk"/>
Nov 03 17:29:32 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:32 user nova-compute[75463]:     </disk>
Nov 03 17:29:32 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:32 user nova-compute[75463]:       <mac address="fa:16:3e:26:40:17"/>
Nov 03 17:29:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:32 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:32 user nova-compute[75463]:       <target dev="tapb8a319c0-e9"/>
Nov 03 17:29:32 user nova-compute[75463]:     </interface>
Nov 03 17:29:32 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:32 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/console.log" append="off"/>
Nov 03 17:29:32 user nova-compute[75463]:     </serial>
Nov 03 17:29:32 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:32 user nova-compute[75463]:     <video>
Nov 03 17:29:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:32 user nova-compute[75463]:     </video>
Nov 03 17:29:32 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:32 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:32 user nova-compute[75463]:     </rng>
Nov 03 17:29:32 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:32 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:32 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:32 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:32 user nova-compute[75463]:   </devices>
Nov 03 17:29:32 user nova-compute[75463]: </domain>
Nov 03 17:29:32 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-474918975',display_name='tempest-VolumesAdminNegativeTest-server-474918975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-474918975',id=8,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM2TlN7BaLGgkjjDs+Sx1gXHBztlCLpMMgmDkIsma6BpbHiR1l2L86zc7OuWOGBLEXn7bNQfFsX3seflgA5zED8k8flLWnHBJwPTHyPmJOzqm2SFgU2cP4y45NX/tweuw==',key_name='tempest-keypair-1050106444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-e8hv6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991422c844b4064bb476827300e4119',uuid=8c04ed34-af8a-49b9-99ce-3bb48ef8584b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:32 user nova-compute[75463]: DEBUG os_vif [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0999eab9-d198-525f-8b19-85325abe1228', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8a319c0-e9, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8a319c0-e9, col_values=(('qos', UUID('26d37dfa-ed94-4a11-80d0-4b24ad5b4f4d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8a319c0-e9, col_values=(('external_ids', {'iface-id': 'b8a319c0-e940-4822-aee7-cb026cad6811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:40:17', 'vm-uuid': '8c04ed34-af8a-49b9-99ce-3bb48ef8584b'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:33 user nova-compute[75463]: INFO os_vif [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9')
Nov 03 17:29:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No VIF found with MAC fa:16:3e:26:40:17, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG nova.network.neutron [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updated VIF entry in instance network info cache for port b8a319c0-e940-4822-aee7-cb026cad6811. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG nova.network.neutron [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating instance_info_cache with network_info: [{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a33f185-5b7e-4192-a0ff-3fb1c40ab7f8 req-dbb85bf4-34c0-495d-8058-ab3dbd9f1287 service nova] Releasing lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] No waiting events found dispatching network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:35 user nova-compute[75463]: WARNING nova.compute.manager [req-711d5196-dad0-4942-8f92-ad902e86e936 req-1a6f19a7-1a36-4e47-81ef-c7965089506e service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received unexpected event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 for instance with vm_state building and task_state spawning.
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] No waiting events found dispatching network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:37 user nova-compute[75463]: WARNING nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received unexpected event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 for instance with vm_state building and task_state spawning.
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:37 user nova-compute[75463]: WARNING nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 for instance with vm_state building and task_state spawning.
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:37 user nova-compute[75463]: WARNING nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 for instance with vm_state building and task_state spawning.
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] No waiting events found dispatching network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:37 user nova-compute[75463]: WARNING nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received unexpected event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 for instance with vm_state building and task_state spawning.
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] No waiting events found dispatching network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:37 user nova-compute[75463]: WARNING nova.compute.manager [req-f337091a-f636-4283-be70-8ca5c5c7e8f0 req-4787ffeb-e05e-46a8-97a8-b89b87749481 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received unexpected event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 for instance with vm_state building and task_state spawning.
Nov 03 17:29:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:38 user nova-compute[75463]: INFO nova.compute.claims [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Claim successful on node user
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance spawned successfully.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Took 11.90 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Instance spawned successfully.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Took 13.15 seconds to build instance.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16bcafc1-3086-4770-a4ab-6a67d1d4bed9 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.405s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.claims [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Claim successful on node user
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Instance spawned successfully.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Took 10.85 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.policy [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bda029c294624e9689870edc4385c829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f94a3551fe419dad5248f0b32da45c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Took 14.02 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Took 13.38 seconds to build instance.
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1e415ebb-08c9-4644-9927-1252fd376a31 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.659s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Creating image(s)
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "/opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "/opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "/opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:39 user nova-compute[75463]: INFO nova.compute.manager [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Took 15.27 seconds to build instance.
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30090780-254f-4435-95bc-f40838ba0e15 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.474s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk 1073741824" returned: 0 in 0.073s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.233s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.227s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:29:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Cannot resize image /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Ensure instance console log exists: /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Successfully created port: 2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.policy [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c42ca6cbfbb4065b768b8dab3539c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba6f421521a46c5b14a85c3cb3888d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:29:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Creating image(s)
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "/opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.011s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "/opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.290s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk 1073741824" returned: 0 in 0.075s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:41 user nova-compute[75463]: WARNING nova.compute.manager [req-5e75f0cd-0b73-48a4-bb5d-2e0442c5a923 req-8c515fce-7bee-466e-a6e7-c01a9113ee5f service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state None.
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Successfully updated port: 2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquired lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-changed-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Refreshing instance network info cache due to event network-changed-2801d863-dcfc-4a6a-bc26-1bd5b1575685. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] Acquiring lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.242s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:29:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Cannot resize image /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Ensure instance console log exists: /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Successfully created port: a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updating instance_info_cache with network_info: [{"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Releasing lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Instance network_info: |[{"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] Acquired lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.neutron [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Refreshing network info cache for port 2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Start _get_guest_xml network_info=[{"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-401777592',display_name='tempest-VolumesAssistedSnapshotsTest-server-401777592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-401777592',id=9,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/MUJAQgex8k2TGLfkb8lCSCpfr3dAspub02DijAn+Ukb+kuXyQxNPKOdZocjfowi6v3xQZUfNCB7mRqSuSeAboLE3zsQYEWCKBnLqWPRbZaMbMOGpvJKMCUkhrF23fOQ==',key_name='tempest-keypair-1854853604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6f94a3551fe419dad5248f0b32da45c',ramdisk_id='',reservation_id='r-3hk9dtn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-440291304',owner_user_name='tempest-VolumesAssistedSnapshotsTest-440291304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda029c294624e9689870edc4385c829',uuid=affef3a2-57dd-421c-aaeb-7b2030a51246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converting VIF {"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lazy-loading 'pci_devices' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:42 user nova-compute[75463]:   <uuid>affef3a2-57dd-421c-aaeb-7b2030a51246</uuid>
Nov 03 17:29:42 user nova-compute[75463]:   <name>instance-00000009</name>
Nov 03 17:29:42 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:42 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:42 user nova-compute[75463]:   <metadata>
Nov 03 17:29:42 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:42 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-401777592</nova:name>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:42</nova:creationTime>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:42 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:42 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:user uuid="bda029c294624e9689870edc4385c829">tempest-VolumesAssistedSnapshotsTest-440291304-project-member</nova:user>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:project uuid="b6f94a3551fe419dad5248f0b32da45c">tempest-VolumesAssistedSnapshotsTest-440291304</nova:project>
Nov 03 17:29:42 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:42 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:42 user nova-compute[75463]:         <nova:port uuid="2801d863-dcfc-4a6a-bc26-1bd5b1575685">
Nov 03 17:29:42 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 17:29:42 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:42 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:42 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:42 user nova-compute[75463]:   </metadata>
Nov 03 17:29:42 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:42 user nova-compute[75463]:     <system>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="serial">affef3a2-57dd-421c-aaeb-7b2030a51246</entry>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="uuid">affef3a2-57dd-421c-aaeb-7b2030a51246</entry>
Nov 03 17:29:42 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:42 user nova-compute[75463]:     </system>
Nov 03 17:29:42 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:42 user nova-compute[75463]:   <os>
Nov 03 17:29:42 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:42 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:42 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:42 user nova-compute[75463]:   </os>
Nov 03 17:29:42 user nova-compute[75463]:   <features>
Nov 03 17:29:42 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:42 user nova-compute[75463]:     <apic/>
Nov 03 17:29:42 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:42 user nova-compute[75463]:   </features>
Nov 03 17:29:42 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:42 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:42 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:42 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:42 user nova-compute[75463]:   </clock>
Nov 03 17:29:42 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:42 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:42 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:42 user nova-compute[75463]:   </cpu>
Nov 03 17:29:42 user nova-compute[75463]:   <devices>
Nov 03 17:29:42 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:42 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:42 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk"/>
Nov 03 17:29:42 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:42 user nova-compute[75463]:     </disk>
Nov 03 17:29:42 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:42 user nova-compute[75463]:       <mac address="fa:16:3e:8b:1c:e8"/>
Nov 03 17:29:42 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:42 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:42 user nova-compute[75463]:       <target dev="tap2801d863-dc"/>
Nov 03 17:29:42 user nova-compute[75463]:     </interface>
Nov 03 17:29:42 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:42 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/console.log" append="off"/>
Nov 03 17:29:42 user nova-compute[75463]:     </serial>
Nov 03 17:29:42 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:42 user nova-compute[75463]:     <video>
Nov 03 17:29:42 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:42 user nova-compute[75463]:     </video>
Nov 03 17:29:42 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:42 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:42 user nova-compute[75463]:     </rng>
Nov 03 17:29:42 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:42 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:42 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:42 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:42 user nova-compute[75463]:   </devices>
Nov 03 17:29:42 user nova-compute[75463]: </domain>
Nov 03 17:29:42 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-401777592',display_name='tempest-VolumesAssistedSnapshotsTest-server-401777592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-401777592',id=9,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/MUJAQgex8k2TGLfkb8lCSCpfr3dAspub02DijAn+Ukb+kuXyQxNPKOdZocjfowi6v3xQZUfNCB7mRqSuSeAboLE3zsQYEWCKBnLqWPRbZaMbMOGpvJKMCUkhrF23fOQ==',key_name='tempest-keypair-1854853604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6f94a3551fe419dad5248f0b32da45c',ramdisk_id='',reservation_id='r-3hk9dtn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-440291304',owner_user_name='tempest-VolumesAssistedSnapshotsTest-440291304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda029c294624e9689870edc4385c829',uuid=affef3a2-57dd-421c-aaeb-7b2030a51246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converting VIF {"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG os_vif [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1020a7b5-2819-5976-ab9d-9b2452904d44', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2801d863-dc, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2801d863-dc, col_values=(('qos', UUID('2441ea2f-561a-4079-9cdc-16b2cef0fb87')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2801d863-dc, col_values=(('external_ids', {'iface-id': '2801d863-dcfc-4a6a-bc26-1bd5b1575685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:1c:e8', 'vm-uuid': 'affef3a2-57dd-421c-aaeb-7b2030a51246'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:42 user nova-compute[75463]: INFO os_vif [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc')
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] No VIF found with MAC fa:16:3e:8b:1c:e8, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updated VIF entry in instance network info cache for port 2801d863-dcfc-4a6a-bc26-1bd5b1575685. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updating instance_info_cache with network_info: [{"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9c2f9b4-893e-4303-aa8c-150314b1ba19 req-46de5709-7ac9-4702-9217-26481c4cf34d service nova] Releasing lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Successfully updated port: a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquired lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:43 user nova-compute[75463]: WARNING nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state None.
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] No waiting events found dispatching network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:43 user nova-compute[75463]: WARNING nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received unexpected event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f for instance with vm_state active and task_state None.
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] No waiting events found dispatching network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:43 user nova-compute[75463]: WARNING nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received unexpected event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f for instance with vm_state active and task_state None.
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] No waiting events found dispatching network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:43 user nova-compute[75463]: WARNING nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received unexpected event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 for instance with vm_state active and task_state None.
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-changed-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Refreshing instance network info cache due to event network-changed-a3f165a3-cf11-45d9-9c86-01f5754981ce. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:29:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updating instance_info_cache with network_info: [{"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Releasing lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Instance network_info: |[{"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquired lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Refreshing network info cache for port a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Start _get_guest_xml network_info=[{"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:29:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1973708316',display_name='tempest-TestVolumeSwap-server-1973708316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1973708316',id=10,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo2+wzrAe/qFGDUuT5T6035CoOmGI/aUQfthaqh5nwzO4s+OlNphH1kxXWkkEOhcKea6wYh4AJooej0pZofnwuTDkX4Oc0fRCdd1JFte4Q/a0Lwe9J8kjSqjXqWobzqRA==',key_name='tempest-keypair-1663736946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ba6f421521a46c5b14a85c3cb3888d8',ramdisk_id='',reservation_id='r-k7rsi06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1132161682',owner_user_name='tempest-TestVolumeSwap-1132161682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c42ca6cbfbb4065b768b8dab3539c97',uuid=aa42692c-c217-41b8-a584-c9b33686c643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converting VIF {"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lazy-loading 'pci_devices' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:29:44 user nova-compute[75463]:   <uuid>aa42692c-c217-41b8-a584-c9b33686c643</uuid>
Nov 03 17:29:44 user nova-compute[75463]:   <name>instance-0000000a</name>
Nov 03 17:29:44 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:29:44 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:29:44 user nova-compute[75463]:   <metadata>
Nov 03 17:29:44 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:29:44 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:name>tempest-TestVolumeSwap-server-1973708316</nova:name>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:29:44</nova:creationTime>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:29:44 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:29:44 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:owner>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:user uuid="1c42ca6cbfbb4065b768b8dab3539c97">tempest-TestVolumeSwap-1132161682-project-member</nova:user>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:project uuid="3ba6f421521a46c5b14a85c3cb3888d8">tempest-TestVolumeSwap-1132161682</nova:project>
Nov 03 17:29:44 user nova-compute[75463]:       </nova:owner>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:29:44 user nova-compute[75463]:       <nova:ports>
Nov 03 17:29:44 user nova-compute[75463]:         <nova:port uuid="a3f165a3-cf11-45d9-9c86-01f5754981ce">
Nov 03 17:29:44 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:29:44 user nova-compute[75463]:         </nova:port>
Nov 03 17:29:44 user nova-compute[75463]:       </nova:ports>
Nov 03 17:29:44 user nova-compute[75463]:     </nova:instance>
Nov 03 17:29:44 user nova-compute[75463]:   </metadata>
Nov 03 17:29:44 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:29:44 user nova-compute[75463]:     <system>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="serial">aa42692c-c217-41b8-a584-c9b33686c643</entry>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="uuid">aa42692c-c217-41b8-a584-c9b33686c643</entry>
Nov 03 17:29:44 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:29:44 user nova-compute[75463]:     </system>
Nov 03 17:29:44 user nova-compute[75463]:   </sysinfo>
Nov 03 17:29:44 user nova-compute[75463]:   <os>
Nov 03 17:29:44 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:29:44 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:29:44 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:29:44 user nova-compute[75463]:   </os>
Nov 03 17:29:44 user nova-compute[75463]:   <features>
Nov 03 17:29:44 user nova-compute[75463]:     <acpi/>
Nov 03 17:29:44 user nova-compute[75463]:     <apic/>
Nov 03 17:29:44 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:29:44 user nova-compute[75463]:   </features>
Nov 03 17:29:44 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:29:44 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:29:44 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:29:44 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:29:44 user nova-compute[75463]:   </clock>
Nov 03 17:29:44 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:29:44 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:29:44 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:29:44 user nova-compute[75463]:   </cpu>
Nov 03 17:29:44 user nova-compute[75463]:   <devices>
Nov 03 17:29:44 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:29:44 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:29:44 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk"/>
Nov 03 17:29:44 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:29:44 user nova-compute[75463]:     </disk>
Nov 03 17:29:44 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:29:44 user nova-compute[75463]:       <mac address="fa:16:3e:79:ba:68"/>
Nov 03 17:29:44 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:44 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:29:44 user nova-compute[75463]:       <target dev="tapa3f165a3-cf"/>
Nov 03 17:29:44 user nova-compute[75463]:     </interface>
Nov 03 17:29:44 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:29:44 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/console.log" append="off"/>
Nov 03 17:29:44 user nova-compute[75463]:     </serial>
Nov 03 17:29:44 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:29:44 user nova-compute[75463]:     <video>
Nov 03 17:29:44 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:29:44 user nova-compute[75463]:     </video>
Nov 03 17:29:44 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:29:44 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:29:44 user nova-compute[75463]:     </rng>
Nov 03 17:29:44 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:29:44 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:29:44 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:29:44 user nova-compute[75463]:     </memballoon>
Nov 03 17:29:44 user nova-compute[75463]:   </devices>
Nov 03 17:29:44 user nova-compute[75463]: </domain>
Nov 03 17:29:44 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1973708316',display_name='tempest-TestVolumeSwap-server-1973708316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1973708316',id=10,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo2+wzrAe/qFGDUuT5T6035CoOmGI/aUQfthaqh5nwzO4s+OlNphH1kxXWkkEOhcKea6wYh4AJooej0pZofnwuTDkX4Oc0fRCdd1JFte4Q/a0Lwe9J8kjSqjXqWobzqRA==',key_name='tempest-keypair-1663736946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ba6f421521a46c5b14a85c3cb3888d8',ramdisk_id='',reservation_id='r-k7rsi06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1132161682',owner_user_name='tempest-TestVolumeSwap-1132161682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c42ca6cbfbb4065b768b8dab3539c97',uuid=aa42692c-c217-41b8-a584-c9b33686c643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converting VIF {"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG os_vif [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fec6aa60-2a6c-5cad-9f99-5612c1e7d8bc', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f165a3-cf, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3f165a3-cf, col_values=(('qos', UUID('2a565c45-aeba-43d6-af91-03016f696985')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3f165a3-cf, col_values=(('external_ids', {'iface-id': 'a3f165a3-cf11-45d9-9c86-01f5754981ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:ba:68', 'vm-uuid': 'aa42692c-c217-41b8-a584-c9b33686c643'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: INFO os_vif [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf')
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] No VIF found with MAC fa:16:3e:79:ba:68, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Skipping network cache update for instance because it is Building. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Skipping network cache update for instance because it is Building. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:29:44 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updated VIF entry in instance network info cache for port a3f165a3-cf11-45d9-9c86-01f5754981ce. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updating instance_info_cache with network_info: [{"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Releasing lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] No waiting events found dispatching network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:45 user nova-compute[75463]: WARNING nova.compute.manager [req-c57494e3-8f45-4e5e-bce9-5d91b04b1257 req-a4d6d46f-8e48-487c-ae10-6ef6eec08cde service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received unexpected event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 for instance with vm_state active and task_state None.
Nov 03 17:29:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updating instance_info_cache with network_info: [{"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:29:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] No waiting events found dispatching network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:47 user nova-compute[75463]: WARNING nova.compute.manager [req-96ec3e72-644d-415b-915a-1e2688be5ba2 req-96ae4829-7a58-4fe7-b39e-6fa21fa0058e service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received unexpected event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce for instance with vm_state building and task_state spawning.
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Instance spawned successfully.
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:48 user nova-compute[75463]: INFO nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Took 9.05 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:49 user nova-compute[75463]: INFO nova.compute.manager [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Took 10.46 seconds to build instance.
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a8cd4316-cf85-4d24-b3a5-3f5d64852fd0 tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.580s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] No waiting events found dispatching network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:29:49 user nova-compute[75463]: WARNING nova.compute.manager [req-de6ab54f-6a5f-4e93-9ad3-3dfff31a19a7 req-0f50aaec-1f7b-4c29-bbc4-314ec937b000 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received unexpected event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce for instance with vm_state building and task_state spawning.
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:29:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Instance spawned successfully.
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:49 user nova-compute[75463]: INFO nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Took 8.39 seconds to spawn the instance on the hypervisor.
Nov 03 17:29:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:29:49 user nova-compute[75463]: INFO nova.compute.manager [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Took 10.19 seconds to build instance.
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a960d967-5fa9-4985-9c9d-dbed9dfac420 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.334s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:29:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:29:52 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:52 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:29:52 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7580MB free_disk=25.560096740722656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:29:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:29:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance affef3a2-57dd-421c-aaeb-7b2030a51246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:29:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.180s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:29:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:29:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] No waiting events found dispatching network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:01 user nova-compute[75463]: WARNING nova.compute.manager [req-7895a54d-3e3d-4905-aaeb-99e99cbd392d req-2cbcb677-8347-4484-a233-9526173d754b service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received unexpected event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 for instance with vm_state active and task_state None.
Nov 03 17:30:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] No waiting events found dispatching network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:03 user nova-compute[75463]: WARNING nova.compute.manager [req-c3ccce59-a3fb-4cc3-9302-e47b744484f2 req-31adc377-95d9-4337-9865-0df29938b506 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received unexpected event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 for instance with vm_state active and task_state None.
Nov 03 17:30:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:30:08 user nova-compute[75463]: INFO nova.compute.claims [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Claim successful on node user
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:30:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:30:08 user nova-compute[75463]: DEBUG nova.policy [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb8d92159473468e9a75ed0a90d9ec10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '462cbd38529a42029b3f65c2db8425bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:30:08 user nova-compute[75463]: INFO nova.virt.block_device [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Booting with volume 5f8552c3-a6cd-4a56-8643-c73eef62e850 at /dev/vda
Nov 03 17:30:08 user nova-compute[75463]: DEBUG os_brick.utils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:30:08 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5bp3t3nj/privsep.sock']
Nov 03 17:30:08 user sudo[86916]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5bp3t3nj/privsep.sock
Nov 03 17:30:08 user sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Successfully created port: 1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Successfully updated port: 1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquired lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-changed-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Refreshing instance network info cache due to event network-changed-1b4e3c7e-d09d-492f-9615-eea70a3106f6. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] Acquiring lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating instance_info_cache with network_info: [{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Releasing lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance network_info: |[{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] Acquired lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Refreshing network info cache for port 1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:10 user sudo[86916]: pam_unix(sudo:session): session closed for user root
Nov 03 17:30:10 user nova-compute[75463]: INFO oslo.privsep.daemon [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Spawned new privsep daemon via rootwrap
Nov 03 17:30:10 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 03 17:30:10 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 03 17:30:10 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 03 17:30:10 user nova-compute[75463]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86919
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ea2e33-e3ba-4b07-a10e-146d12b0d32c]: (2,) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updated VIF entry in instance network info cache for port 1b4e3c7e-d09d-492f-9615-eea70a3106f6. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating instance_info_cache with network_info: [{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6f1984a8-df05-4aac-8685-ed513116b170 req-a2d974ea-6566-4f27-b0f1-0be5a5c9f239 service nova] Releasing lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d855fa-f8ef-446e-82bb-0daabb0b4908]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: WARNING os_brick.initiator.connectors.nvmeof [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073aea1-3273-489b-abcb-76bdb05fd20e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99600c94-daf0-4b76-857b-cffe5c3c6f03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5bd6a9-c7e3-4b1f-b469-68f11c449000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:10 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:30:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b256196-53c5-427e-a7b0-394974493f31]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG os_brick.utils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== get_connector_properties: return (1925ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:30:10 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating existing volume attachment record: 48ccf627-5e8a-4ae8-b122-524cb2367402 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:30:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Creating image(s)
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Ensure instance console log exists: /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start _get_guest_xml network_info=[{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '934190b6-f35a-4a1e-8e5e-3c76137f9f73', 'attached_at': '', 'detached_at': '', 'volume_id': '5f8552c3-a6cd-4a56-8643-c73eef62e850', 'serial': '5f8552c3-a6cd-4a56-8643-c73eef62e850'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '48ccf627-5e8a-4ae8-b122-524cb2367402', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:30:32 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:32 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connector [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Factory for ISCSI on None {{(pid=75463) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:30:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:30:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:30:32 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741a187-2fd0-4e18-8635-81cb6c61acd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:30:32 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c15432-e792-4510-86b6-b9ee09b21a17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850] added
Nov 03 17:30:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7058c54a-c72c-4cf4-9b43-bb0290d1c7ba]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e92b97-1144-4f68-894f-38f499656323]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIvTnJZp {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIvTnJZp" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae863ab-85b1-44d2-9540-fdea4ab5d780]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIvTnJZp'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f7f07-31ef-4378-9711-8316b8f67c26]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1bcca9-9e05-4ba0-abe5-56ee32e6786c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:30:32 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:30:32 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:30:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:30:32 user nova-compute[75463]: 
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c3a6b-f8d9-4804-973a-4e2665604784]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]
Nov 03 17:30:32 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.
Nov 03 17:30:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed7c07-45f3-45aa-8b2e-d246ada3ec75]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2f454-855d-4fec-aa24-d478b9fe4767]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:30:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:30:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ccc38-6018-47c2-b43e-927b36cc6363]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:30:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26232373363646434', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232373363646434', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1841530318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lazy-loading 'pci_devices' on Instance uuid 934190b6-f35a-4a1e-8e5e-3c76137f9f73 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:30:33 user nova-compute[75463]:   <uuid>934190b6-f35a-4a1e-8e5e-3c76137f9f73</uuid>
Nov 03 17:30:33 user nova-compute[75463]:   <name>instance-0000000b</name>
Nov 03 17:30:33 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:30:33 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:30:33 user nova-compute[75463]:   <metadata>
Nov 03 17:30:33 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:30:33 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:30:33 user nova-compute[75463]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1841530318</nova:name>
Nov 03 17:30:33 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:30:32</nova:creationTime>
Nov 03 17:30:33 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:30:33 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:30:33 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:30:33 user nova-compute[75463]:       <nova:owner>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:user uuid="eb8d92159473468e9a75ed0a90d9ec10">tempest-ServerActionsV293TestJSON-322207706-project-member</nova:user>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:project uuid="462cbd38529a42029b3f65c2db8425bb">tempest-ServerActionsV293TestJSON-322207706</nova:project>
Nov 03 17:30:33 user nova-compute[75463]:       </nova:owner>
Nov 03 17:30:33 user nova-compute[75463]:       <nova:ports>
Nov 03 17:30:33 user nova-compute[75463]:         <nova:port uuid="1b4e3c7e-d09d-492f-9615-eea70a3106f6">
Nov 03 17:30:33 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 17:30:33 user nova-compute[75463]:         </nova:port>
Nov 03 17:30:33 user nova-compute[75463]:       </nova:ports>
Nov 03 17:30:33 user nova-compute[75463]:     </nova:instance>
Nov 03 17:30:33 user nova-compute[75463]:   </metadata>
Nov 03 17:30:33 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:30:33 user nova-compute[75463]:     <system>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="serial">934190b6-f35a-4a1e-8e5e-3c76137f9f73</entry>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="uuid">934190b6-f35a-4a1e-8e5e-3c76137f9f73</entry>
Nov 03 17:30:33 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:30:33 user nova-compute[75463]:     </system>
Nov 03 17:30:33 user nova-compute[75463]:   </sysinfo>
Nov 03 17:30:33 user nova-compute[75463]:   <os>
Nov 03 17:30:33 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:30:33 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:30:33 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:30:33 user nova-compute[75463]:   </os>
Nov 03 17:30:33 user nova-compute[75463]:   <features>
Nov 03 17:30:33 user nova-compute[75463]:     <acpi/>
Nov 03 17:30:33 user nova-compute[75463]:     <apic/>
Nov 03 17:30:33 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:30:33 user nova-compute[75463]:   </features>
Nov 03 17:30:33 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:30:33 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:30:33 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:30:33 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:30:33 user nova-compute[75463]:   </clock>
Nov 03 17:30:33 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:30:33 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:30:33 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:30:33 user nova-compute[75463]:   </cpu>
Nov 03 17:30:33 user nova-compute[75463]:   <devices>
Nov 03 17:30:33 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:30:33 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:30:33 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:30:33 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:30:33 user nova-compute[75463]:       <serial>5f8552c3-a6cd-4a56-8643-c73eef62e850</serial>
Nov 03 17:30:33 user nova-compute[75463]:     </disk>
Nov 03 17:30:33 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:30:33 user nova-compute[75463]:       <mac address="fa:16:3e:26:3e:53"/>
Nov 03 17:30:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:30:33 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:30:33 user nova-compute[75463]:       <target dev="tap1b4e3c7e-d0"/>
Nov 03 17:30:33 user nova-compute[75463]:     </interface>
Nov 03 17:30:33 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:30:33 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73/console.log" append="off"/>
Nov 03 17:30:33 user nova-compute[75463]:     </serial>
Nov 03 17:30:33 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:30:33 user nova-compute[75463]:     <video>
Nov 03 17:30:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:30:33 user nova-compute[75463]:     </video>
Nov 03 17:30:33 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:30:33 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:30:33 user nova-compute[75463]:     </rng>
Nov 03 17:30:33 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:30:33 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:30:33 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:30:33 user nova-compute[75463]:     </memballoon>
Nov 03 17:30:33 user nova-compute[75463]:   </devices>
Nov 03 17:30:33 user nova-compute[75463]: </domain>
Nov 03 17:30:33 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1841530318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG os_vif [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '159ebf13-3a74-569f-9c4b-17461a407aa7', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b4e3c7e-d0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b4e3c7e-d0, col_values=(('qos', UUID('aebfa0ff-92bb-48dc-a73a-908072e1a396')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b4e3c7e-d0, col_values=(('external_ids', {'iface-id': '1b4e3c7e-d09d-492f-9615-eea70a3106f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3e:53', 'vm-uuid': '934190b6-f35a-4a1e-8e5e-3c76137f9f73'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:33 user nova-compute[75463]: INFO os_vif [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0')
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] No VIF found with MAC fa:16:3e:26:3e:53, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:30:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:35 user nova-compute[75463]: WARNING nova.compute.manager [req-bca8179b-39fd-478b-9bc2-050646341265 req-0b8ddcee-6799-42fc-a31f-d0a0c82e26c5 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state building and task_state spawning.
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:37 user nova-compute[75463]: WARNING nova.compute.manager [req-b3dca199-d0c5-4cf4-8052-0ca524efed74 req-c6378f63-b29c-46ef-a86d-5da8a04dceb9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state building and task_state spawning.
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:30:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance spawned successfully.
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:30:37 user nova-compute[75463]: INFO nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 03 17:30:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:30:37 user nova-compute[75463]: INFO nova.compute.manager [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Took 29.76 seconds to build instance.
Nov 03 17:30:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e4e294f8-1637-4d93-98c4-2f8e1f7f3b6c tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.863s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:42 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:30:42 user nova-compute[75463]: INFO nova.compute.claims [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Claim successful on node user
Nov 03 17:30:42 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:30:43 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:30:43 user nova-compute[75463]: INFO nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Booting with volume dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 at /dev/vda
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.policy [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb7e9c88f7ab4fb7b205452ec24c75f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a0d997a83745debe050f94c1896711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10ca89-6b27-4cf3-aa7e-8d78d80749c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[365176ab-089e-4fcf-a015-d62053b0263e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726dc2a-0cc0-4e1e-a96a-7c84078f9d30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e254071f-5444-411d-aa3a-fe6f6aeb8540]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:43 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:30:43 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191a25e-5bcc-4887-9b62-82f655beff25]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating existing volume attachment record: 13aa0d03-6b36-4352-85c8-3e55623e1425 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:30:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:44 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully created port: 5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:44 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully created port: ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:30:45 user nova-compute[75463]: INFO nova.compute.manager [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] instance snapshotting
Nov 03 17:30:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Beginning live snapshot process
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully created port: 769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json -f qcow2" returned: 0 in 0.328s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:45 user nova-compute[75463]: INFO nova.compute.manager [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Rescuing
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710.delta 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully created port: d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710.delta 1073741824" returned: 0 in 0.062s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:46 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75463) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 03 17:30:46 user nova-compute[75463]: INFO nova.virt.libvirt.host [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] UEFI support detected
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:46 user nova-compute[75463]: WARNING nova.compute.manager [req-77ac92d9-131f-406c-adbc-890272242c1a req-d9d23e0e-168c-4f53-8c74-d1b201c8f7cd service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state rescuing.
Nov 03 17:30:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:46 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully created port: a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:30:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance destroyed successfully.
Nov 03 17:30:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Attempting rescue
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75463) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 17:30:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Creating image(s)
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'trusted_certs' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:30:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: 5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-5f9b73f9-a93e-48f3-bbef-0be495c7e08a. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port 5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710.delta /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue" returned: 0 in 0.069s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'migration_context' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.base [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<bd9327c9-ae8e-424e-ac57-026284f57f85> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start _get_guest_xml network_info=[{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:9c:12:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.base [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<bd9327c9-ae8e-424e-ac57-026284f57f85> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:30:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'numa_topology' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.objects.base [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<bd9327c9-ae8e-424e-ac57-026284f57f85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:30:48 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:48 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.objects.base [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<bd9327c9-ae8e-424e-ac57-026284f57f85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457135785',display_name='tempest-ServerRescueNegativeTestJSON-server-1457135785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457135785',id=4,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-zuajlzo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:11Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=bd9327c9-ae8e-424e-ac57-026284f57f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:9c:12:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:9c:12:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-765ac4c5-bb42-42c1-81ab-8f66b3c2dfce req-4ee7b35a-0d24-4bd3-ba2f-90410f635a2f service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.objects.base [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<bd9327c9-ae8e-424e-ac57-026284f57f85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:30:48 user nova-compute[75463]:   <uuid>bd9327c9-ae8e-424e-ac57-026284f57f85</uuid>
Nov 03 17:30:48 user nova-compute[75463]:   <name>instance-00000004</name>
Nov 03 17:30:48 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:30:48 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:30:48 user nova-compute[75463]:   <metadata>
Nov 03 17:30:48 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:30:48 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1457135785</nova:name>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:30:48</nova:creationTime>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:30:48 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:30:48 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:owner>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:30:48 user nova-compute[75463]:       </nova:owner>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:30:48 user nova-compute[75463]:       <nova:ports>
Nov 03 17:30:48 user nova-compute[75463]:         <nova:port uuid="2ac39514-25cc-4625-95e7-4b440a2a51b2">
Nov 03 17:30:48 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:30:48 user nova-compute[75463]:         </nova:port>
Nov 03 17:30:48 user nova-compute[75463]:       </nova:ports>
Nov 03 17:30:48 user nova-compute[75463]:     </nova:instance>
Nov 03 17:30:48 user nova-compute[75463]:   </metadata>
Nov 03 17:30:48 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:30:48 user nova-compute[75463]:     <system>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="serial">bd9327c9-ae8e-424e-ac57-026284f57f85</entry>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="uuid">bd9327c9-ae8e-424e-ac57-026284f57f85</entry>
Nov 03 17:30:48 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:30:48 user nova-compute[75463]:     </system>
Nov 03 17:30:48 user nova-compute[75463]:   </sysinfo>
Nov 03 17:30:48 user nova-compute[75463]:   <os>
Nov 03 17:30:48 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:30:48 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:30:48 user nova-compute[75463]:   </os>
Nov 03 17:30:48 user nova-compute[75463]:   <features>
Nov 03 17:30:48 user nova-compute[75463]:     <acpi/>
Nov 03 17:30:48 user nova-compute[75463]:     <apic/>
Nov 03 17:30:48 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:30:48 user nova-compute[75463]:   </features>
Nov 03 17:30:48 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:30:48 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:30:48 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:30:48 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:30:48 user nova-compute[75463]:   </clock>
Nov 03 17:30:48 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:30:48 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:30:48 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:30:48 user nova-compute[75463]:   </cpu>
Nov 03 17:30:48 user nova-compute[75463]:   <devices>
Nov 03 17:30:48 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:30:48 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:30:48 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue"/>
Nov 03 17:30:48 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:30:48 user nova-compute[75463]:     </disk>
Nov 03 17:30:48 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:30:48 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:30:48 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk"/>
Nov 03 17:30:48 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:30:48 user nova-compute[75463]:     </disk>
Nov 03 17:30:48 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:30:48 user nova-compute[75463]:       <mac address="fa:16:3e:9c:12:72"/>
Nov 03 17:30:48 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:30:48 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:30:48 user nova-compute[75463]:       <target dev="tap2ac39514-25"/>
Nov 03 17:30:48 user nova-compute[75463]:     </interface>
Nov 03 17:30:48 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:30:48 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/console.log" append="off"/>
Nov 03 17:30:48 user nova-compute[75463]:     </serial>
Nov 03 17:30:48 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:30:48 user nova-compute[75463]:     <video>
Nov 03 17:30:48 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:30:48 user nova-compute[75463]:     </video>
Nov 03 17:30:48 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:30:48 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:30:48 user nova-compute[75463]:     </rng>
Nov 03 17:30:48 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:30:48 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:30:48 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:30:48 user nova-compute[75463]:     </memballoon>
Nov 03 17:30:48 user nova-compute[75463]:   </devices>
Nov 03 17:30:48 user nova-compute[75463]: </domain>
Nov 03 17:30:48 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:30:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance destroyed successfully.
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710.delta /opt/stack/data/nova/instances/snapshots/tmpz1czae91/fd2b4b28c37c4fd49966ff1b051f5710" returned: 0 in 0.599s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Snapshot extracted, beginning image upload
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:9c:12:72, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: 88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:48 user nova-compute[75463]: WARNING nova.compute.manager [req-9476b380-9cbc-4bf0-bf9d-76d51006b120 req-c92e9e56-5b07-47f7-8894-b2795dc2b251 service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state rescuing.
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lazy-loading 'flavor' on Instance uuid 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:49 user nova-compute[75463]: INFO nova.compute.manager [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Attaching volume bde19ce2-4467-4374-937b-2ed56cd708e4 to /dev/vdb
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: 8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.utils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[071750f0-f832-4d27-aaaf-3a35bc1a6d21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e12218-ff17-4026-84fc-7e8f829041b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[414d7b75-aaab-4e52-960e-c5b7d4f93275]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d308defa-beaf-4f61-ad4a-591ac2672242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:30:49 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4bec88-ae2c-4a28-b4b7-212e3275242e]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG os_brick.utils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updating existing volume attachment record: 081a78f6-2832-4c47-a348-31002d0c515c {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-88afdc4c-f0ce-41f0-80ec-91d526a8329f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port 88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-8076f1d6-eb6d-4430-b601-1aad292f8cb2. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port 8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cf4ef726-de8b-4779-ba6a-669bdf5a2085 req-a93ef988-3117-49e0-ab25-aaf271d65481 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:50 user nova-compute[75463]: WARNING nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state rescuing.
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:30:50 user nova-compute[75463]: WARNING nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state active and task_state rescuing.
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-ffa18fac-3162-43af-a550-254a6e897464. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e3de6b6-098e-4ffe-8f3b-572ee2d48c4d req-1fa2b8d2-6bf0-4ebf-9e25-8b89fc487e9a service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:51 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: 769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Snapshot image upload complete
Nov 03 17:30:51 user nova-compute[75463]: INFO nova.compute.manager [None req-94217218-0731-46ab-b003-0c82211c6f31 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Took 6.82 seconds to snapshot the instance on the hypervisor.
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b510e4b-5d2d-4d76-b023-971bf198c4ba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-769ebb0a-75f2-4063-8537-e36895b29b22. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port 769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Successfully updated port: a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:30:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-d405e3ff-75b9-4ef2-8071-08751d53f470. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.394s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b5a23cfc-740e-4bf5-9fc0-1cd77782a596 req-a2c64c77-eb9d-46a4-8131-5f39ef2606f4 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-a16f54e0-444b-4e24-8bab-162e0d3fb29e. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance network_info: |[{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updated VIF entry in instance network info cache for port a16f54e0-444b-4e24-8bab-162e0d3fb29e. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e7357f6-ec8a-45b2-8e73-ba277c512d3b req-9f154ead-65cf-420d-8a8b-37dcfde7b1b1 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:30:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:30:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:30:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7005MB free_disk=25.3768310546875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:30:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:30:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance affef3a2-57dd-421c-aaeb-7b2030a51246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7a12db62-26a6-47fa-906c-d92f67e08084 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-changed-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Refreshing instance network info cache due to event network-changed-01cbe183-9bb3-46fa-9c2a-e32d591c6c81. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] Acquiring lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] Acquired lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:30:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Refreshing network info cache for port 01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:30:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updated VIF entry in instance network info cache for port 01cbe183-9bb3-46fa-9c2a-e32d591c6c81. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:30:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating instance_info_cache with network_info: [{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:30:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8fa275da-7472-46ae-824f-7834c27e2c25 req-80abed41-fcb9-4493-9c5d-deaf3f0efc9d service nova] Releasing lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:31:00 user nova-compute[75463]: INFO nova.compute.manager [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] instance snapshotting
Nov 03 17:31:00 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Beginning live snapshot process
Nov 03 17:31:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac.delta 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac.delta 1073741824" returned: 0 in 0.050s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 17:31:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:31:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] COPY block job progress, current cursor: 26017792 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:31:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:31:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 17:31:03 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:31:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac.delta /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac.delta /opt/stack/data/nova/instances/snapshots/tmpn0k6ecu8/9b6f0775cc994b38ba7e2f8efc6329ac" returned: 0 in 0.254s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Snapshot extracted, beginning image upload
Nov 03 17:31:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Snapshot image upload complete
Nov 03 17:31:06 user nova-compute[75463]: INFO nova.compute.manager [None req-9f100014-8212-428c-b150-6fcf30b95f8b tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Took 6.38 seconds to snapshot the instance on the hypervisor.
Nov 03 17:31:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:08 user nova-compute[75463]: INFO nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Booting with volume d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 at /dev/vdb
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52e4a5-fe33-496a-9c01-15fd31dd5dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f95727-5e88-4e5a-9d3e-9f68527b6934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[479196d3-b2fa-4f59-802e-958481bb6392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fae5f9-9df7-45c2-afea-5d95b62c3756]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:31:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[588f87cf-b93b-4a30-b349-a7e33485aea7]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:09 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating existing volume attachment record: f7e9425b-d101-4deb-8a97-dedb46bb77b6 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:31:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFkVYWBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:14 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:31:14 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:31:14 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9068c-2440-4245-8c6f-808ae60e66a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:31:14 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b14517d-985f-4037-b2f2-634076dd6ede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4] added
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cfe1ea-faa0-412c-b53c-64ed7a53600c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ea368-c3fc-4604-85c4-ee17652f32ba]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFkVYWBQ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFkVYWBQ" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e7dfdb-f22d-45f2-acab-307cfa0753bf]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tFkVYWBQ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c509da-ea89-4e8f-8d36-62b8e4f7023b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec174656-7b53-4ba4-b491-3ae255bb46da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4407b9-3e44-42bd-bf35-daf1f336b69a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260]
Nov 03 17:31:14 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260] successful.
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1f61b-12fd-478e-9f05-b6eb2e9d6d7b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d603032-2f2c-4658-885e-569ffa3bbbdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)
Nov 03 17:31:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:31:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2ae1a7-0286-4f14-9f5f-72396921bb7f]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFkVYWBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-changed-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing instance network info cache due to event network-changed-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing network info cache for port 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updated VIF entry in instance network info cache for port 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7cb9c5e3-81fe-44e0-b267-754b94d89c2d req-7873c48a-6614-4187-87ef-e8bb4e84ca38 service nova] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'pci_requests' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.objects.base [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Object Instance<3394c83b-9dc5-44a5-8af9-122da4f80233> lazy-loaded attributes: flavor,pci_requests {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:31:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.policy [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7015a1cbbd024518b9590d2561dc02db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2f7989faf6b4c08b25287cd6fb74ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26263666332393936', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263666332393936', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lazy-loading 'flavor' on Instance uuid 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:31:16 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:31:16 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:31:16 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:31:16 user nova-compute[75463]:   <serial>bde19ce2-4467-4374-937b-2ed56cd708e4</serial>
Nov 03 17:31:16 user nova-compute[75463]: </disk>
Nov 03 17:31:16 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] No VIF found with MAC fa:16:3e:80:d5:3b, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Successfully created port: 799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a822cac0-67ab-4963-8e59-71a61594d848 tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.328s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Successfully updated port: 799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-changed-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing instance network info cache due to event network-changed-799c433d-5512-409d-9ea7-1bb7a03d7ad4. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-changed-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Refreshing instance network info cache due to event network-changed-00db5cb6-0806-4249-ad16-50f5d22750b0. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] Acquiring lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] Acquired lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Refreshing network info cache for port 00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-changed-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Refreshing instance network info cache due to event network-changed-b8a319c0-e940-4822-aee7-cb026cad6811. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] Acquiring lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] Acquired lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Refreshing network info cache for port b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updated VIF entry in instance network info cache for port 00db5cb6-0806-4249-ad16-50f5d22750b0. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating instance_info_cache with network_info: [{"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updated VIF entry in instance network info cache for port b8a319c0-e940-4822-aee7-cb026cad6811. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating instance_info_cache with network_info: [{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cb41c331-0798-4e72-a067-ec6309fef800 req-8c706db2-db14-4df3-a544-f9d1a0ede0cc service nova] Releasing lock "refresh_cache-26968122-309b-4eb1-ad6e-bddd5e4639a6" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10ba5310-c2a4-4816-a695-a249bca61512 req-dc6345dd-fb6c-4d36-aeff-e4f2db25725d service nova] Releasing lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:18 user nova-compute[75463]: INFO nova.compute.manager [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Terminating instance
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Refreshing network info cache for port 799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG os_vif [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db7b974c-4eb6-5ff0-9e20-737f5748d5a2', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap799c433d-55, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap799c433d-55, col_values=(('qos', UUID('57190280-3a2f-4881-9792-00a7b6625d59')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap799c433d-55, col_values=(('external_ids', {'iface-id': '799c433d-5512-409d-9ea7-1bb7a03d7ad4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:19:0d', 'vm-uuid': '3394c83b-9dc5-44a5-8af9-122da4f80233'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: INFO os_vif [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55')
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] attach device xml: <interface type="ethernet">
Nov 03 17:31:18 user nova-compute[75463]:   <mac address="fa:16:3e:8d:19:0d"/>
Nov 03 17:31:18 user nova-compute[75463]:   <model type="virtio"/>
Nov 03 17:31:18 user nova-compute[75463]:   <mtu size="1442"/>
Nov 03 17:31:18 user nova-compute[75463]:   <target dev="tap799c433d-55"/>
Nov 03 17:31:18 user nova-compute[75463]: </interface>
Nov 03 17:31:18 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updated VIF entry in instance network info cache for port 799c433d-5512-409d-9ea7-1bb7a03d7ad4. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-333a7b94-6f76-47f9-9b9e-65bb61f8efb1 req-2b84409e-8baa-4c4b-bbf0-e0f027a697b4 service nova] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name hda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No VIF found with MAC fa:16:3e:d6:09:cb, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:31:19 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:31:19</nova:creationTime>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:31:19 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:31:19 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:owner>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:31:19 user nova-compute[75463]:   </nova:owner>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:31:19 user nova-compute[75463]:   <nova:ports>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:31:19 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:31:19 user nova-compute[75463]:     </nova:port>
Nov 03 17:31:19 user nova-compute[75463]:     <nova:port uuid="799c433d-5512-409d-9ea7-1bb7a03d7ad4">
Nov 03 17:31:19 user nova-compute[75463]:       <nova:ip type="fixed" address="10.10.10.114" ipVersion="4"/>
Nov 03 17:31:19 user nova-compute[75463]:     </nova:port>
Nov 03 17:31:19 user nova-compute[75463]:   </nova:ports>
Nov 03 17:31:19 user nova-compute[75463]: </nova:instance>
Nov 03 17:31:19 user nova-compute[75463]:  {{(pid=75463) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9dbeb99b-3b85-4b38-b93a-cecaf61724f2 tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.322s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Instance destroyed successfully.
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lazy-loading 'resources' on Instance uuid 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-980164017',display_name='tempest-DeleteServersTestJSON-server-980164017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-980164017',id=1,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01d9d83719b645ecac611cdaec3b8c59',ramdisk_id='',reservation_id='r-482q8s8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-965195714',owner_user_name='tempest-DeleteServersTestJSON-965195714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:12Z,user_data=None,user_id='60c4a5139bae4304aed5c5fddebd9d18',uuid=728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converting VIF {"id": "067c14a0-e818-4595-987f-ffe308f00a6f", "address": "fa:16:3e:80:d5:3b", "network": {"id": "cdcaf353-9def-4235-906a-11d4eb01a435", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-887008784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01d9d83719b645ecac611cdaec3b8c59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067c14a0-e8", "ovs_interfaceid": "067c14a0-e818-4595-987f-ffe308f00a6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_vif [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067c14a0-e8, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6595ec82-d6f5-4c5d-9d68-304667aeaf49) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:19 user nova-compute[75463]: INFO os_vif [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:d5:3b,bridge_name='br-int',has_traffic_filtering=True,id=067c14a0-e818-4595-987f-ffe308f00a6f,network=Network(cdcaf353-9def-4235-906a-11d4eb01a435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067c14a0-e8')
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFkVYWBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:19 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a168a-ef8f-4c08-bfa8-5609c3144897]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:31:19 user nova-compute[75463]: No targets found.
Nov 03 17:31:19 user nova-compute[75463]: iSNS:
Nov 03 17:31:19 user nova-compute[75463]: No targets found.
Nov 03 17:31:19 user nova-compute[75463]: STATIC:
Nov 03 17:31:19 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:31:19 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:31:19 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:31:19 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4
Nov 03 17:31:19 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:31:19 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:31:19 user nova-compute[75463]: FIRMWARE:
Nov 03 17:31:19 user nova-compute[75463]: No targets found.
Nov 03 17:31:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:31:19 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:31:19 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8bff5-b870-44fb-80b6-13dd2a9542cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:31:19 user nova-compute[75463]: WARNING nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 for instance with vm_state active and task_state None.
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:31:19 user nova-compute[75463]: WARNING nova.compute.manager [req-af020f67-669f-4251-bf2d-82d3b7ec08b9 req-59e369fa-9396-4b8a-8ee0-5db2866dd3e1 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 for instance with vm_state active and task_state None.
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe36c6-b4e0-4704-a7ef-aae2011a1bb1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:19 user nova-compute[75463]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)
Nov 03 17:31:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:19 user nova-compute[75463]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 (non-flash)
Nov 03 17:31:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c2ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aef069-ea0d-4e04-b910-302d648eb09a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39a9f8-e54e-4a07-8fab-d283dea66fde]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94688ad4-2f80-49ae-9b76-11978c001c0d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[20821cf3-5a16-49fa-b052-e61e7ca36d50]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-unplugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] No waiting events found dispatching network-vif-unplugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-unplugged-067c14a0-e818-4595-987f-ffe308f00a6f for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Acquiring lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] No waiting events found dispatching network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:31:19 user nova-compute[75463]: WARNING nova.compute.manager [req-d87cf871-5b4d-49ea-881e-efbe45f508e5 req-b2eafc40-a39d-46cf-90ee-069607eaabf8 service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received unexpected event network-vif-plugged-067c14a0-e818-4595-987f-ffe308f00a6f for instance with vm_state active and task_state deleting.
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd62531e-2200-4707-a830-c1e6ed3f1311]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cd52f-6740-45e3-80af-7258294da221]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260]
Nov 03 17:31:19 user nova-compute[75463]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4, portal: 172.16.0.220,3260] successful.
Nov 03 17:31:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bde19ce2-4467-4374-937b-2ed56cd708e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[674074f5-1e1e-478e-b000-dafbeda81e47]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] <== disconnect_volume: return (343ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:31:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Deleting instance files /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60_del
Nov 03 17:31:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Deletion of /opt/stack/data/nova/instances/728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60_del complete
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:19 user nova-compute[75463]: INFO nova.compute.manager [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Attaching volume 88af7a10-48aa-4ae7-a6cc-c02ed48af75c to /dev/vdb
Nov 03 17:31:20 user nova-compute[75463]: INFO nova.compute.manager [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Took 1.92 seconds to destroy the instance on the hypervisor.
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.utils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d3da3-7443-4635-a962-544d3f82e0f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc172145-4df5-47b9-8a15-8225d21277df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6882f-8ff8-4482-a133-24400cd5e2b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53a849-6718-48d7-abae-567a6b281279]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:20 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:31:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[74989c07-bf82-4578-b918-40baeda662e0]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG os_brick.utils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating existing volume attachment record: 128bca9b-d47c-4b56-92fd-5984d91bbafa {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:31:20 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:20 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Took 0.71 seconds to deallocate network for instance.
Nov 03 17:31:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-7d7f36ef-7d95-44a8-890e-3ce4d4230525 req-aef5e0e0-e4d3-42ea-bcc1-3ad8fe9125ff service nova] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Received event network-vif-deleted-067c14a0-e818-4595-987f-ffe308f00a6f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:22 user nova-compute[75463]: INFO nova.compute.manager [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] [instance: 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60] Took 1.34 seconds to detach 1 volumes for instance.
Nov 03 17:31:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:22 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:31:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:31:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:22 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Deleted allocations for instance 728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60
Nov 03 17:31:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6af3de6b-82ee-4dd6-94a5-7a6df23f6e1f tempest-DeleteServersTestJSON-965195714 tempest-DeleteServersTestJSON-965195714-project-member] Lock "728fd9b4-1ff8-4fa6-ad73-d5cbf1118f60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.627s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lazy-loading 'flavor' on Instance uuid 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'flavor' on Instance uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:24 user nova-compute[75463]: INFO nova.compute.manager [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Attaching volume c87e696c-adbb-4eb2-bef5-972c4705d192 to /dev/sdc
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:24 user nova-compute[75463]: INFO nova.compute.manager [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Attaching volume e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 to /dev/vdb
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.utils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5954727a-f502-40d8-9452-3227c4564034]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2658a9-67c0-448b-ab7d-5e9f1141411d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[71553c4a-4f3c-4617-bc68-a84338d35dc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4fda28-a187-451c-b5c7-60c13664d6bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.utils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c6129-f4d7-4497-bf8c-b67ac225a134]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:24 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae9762-fd21-400b-a257-eb5c1bfe3894]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG os_brick.utils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:24 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating existing volume attachment record: c206ea5d-21e6-4e63-8a39-6c46a3f7e46f {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[796cd9eb-c25b-4018-8737-908f7a49822f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd74ac-9576-4762-824c-a5137f7e8729]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc38441-9fa2-408a-bc77-38d4c7cf8d34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:25 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:31:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae5b68-d55e-4124-9166-04a1ee62b5c4]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG os_brick.utils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:25 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating existing volume attachment record: ae5bd89a-f614-4dd5-bc74-f0f1a08be2b7 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:31:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-changed-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Refreshing instance network info cache due to event network-changed-2801d863-dcfc-4a6a-bc26-1bd5b1575685. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] Acquiring lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] Acquired lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.network.neutron [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Refreshing network info cache for port 2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.network.neutron [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updated VIF entry in instance network info cache for port 2801d863-dcfc-4a6a-bc26-1bd5b1575685. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.network.neutron [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updating instance_info_cache with network_info: [{"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adfb1b5c-3176-470e-8466-e4aeb11c4b80 req-0430e5be-bf84-4653-85cd-324bc1210af6 service nova] Releasing lock "refresh_cache-affef3a2-57dd-421c-aaeb-7b2030a51246" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-changed-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Refreshing instance network info cache due to event network-changed-a3f165a3-cf11-45d9-9c86-01f5754981ce. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] Acquiring lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] Acquired lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:29 user nova-compute[75463]: DEBUG nova.network.neutron [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Refreshing network info cache for port a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:30 user nova-compute[75463]: DEBUG nova.network.neutron [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updated VIF entry in instance network info cache for port a3f165a3-cf11-45d9-9c86-01f5754981ce. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:30 user nova-compute[75463]: DEBUG nova.network.neutron [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updating instance_info_cache with network_info: [{"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d07f3623-d988-461d-84fa-1c6c0d847fc5 req-c5069e3d-40b0-4530-b022-71c76a604664 service nova] Releasing lock "refresh_cache-aa42692c-c217-41b8-a584-c9b33686c643" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:31:54 user nova-compute[75463]: INFO nova.compute.claims [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Claim successful on node user
Nov 03 17:31:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:31:54 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:31:54 user nova-compute[75463]: DEBUG nova.policy [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5c6f094b0c423ea22b458b0beecb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b9a3c05c7147b88d7814833b87d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:31:54 user nova-compute[75463]: INFO nova.virt.block_device [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Booting with blank volume at /dev/vda
Nov 03 17:31:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Successfully created port: c700c96d-4e5a-49a1-8889-cbd40946303d {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Successfully updated port: c700c96d-4e5a-49a1-8889-cbd40946303d {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Received event network-changed-c700c96d-4e5a-49a1-8889-cbd40946303d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Refreshing instance network info cache due to event network-changed-c700c96d-4e5a-49a1-8889-cbd40946303d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] Acquiring lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfIbgMzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:56 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:31:56 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:31:56 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15cc651-a143-435e-90ef-5f97564cdd87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:31:56 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a497c68a-1f7b-4cd3-b73e-2b3595b68277]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2] added
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Updating instance_info_cache with network_info: [{"id": "c700c96d-4e5a-49a1-8889-cbd40946303d", "address": "fa:16:3e:d3:6a:0b", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc700c96d-4e", "ovs_interfaceid": "c700c96d-4e5a-49a1-8889-cbd40946303d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Instance network_info: |[{"id": "c700c96d-4e5a-49a1-8889-cbd40946303d", "address": "fa:16:3e:d3:6a:0b", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc700c96d-4e", "ovs_interfaceid": "c700c96d-4e5a-49a1-8889-cbd40946303d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] Acquired lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Refreshing network info cache for port c700c96d-4e5a-49a1-8889-cbd40946303d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1c115f-e8c9-4b64-97f4-6203ef7a0f4e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc2d14-c5cb-45c2-a2c2-be3a891b23b9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfIbgMzQ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfIbgMzQ" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e006d3-bf8e-4516-9455-563588d591a2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfIbgMzQ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f5b10-ad71-4009-a29b-76f12829c2d8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec71aa9-9d12-41cf-bbe6-ebf9482af13e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3203f34-e438-47c6-9599-6356f00fe120]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260]
Nov 03 17:31:56 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260] successful.
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4537bd88-4a98-45da-8ff6-6726077b0ed9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.objects.instance [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lazy-loading 'flavor' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6f032c-b5fa-4c27-a823-3427181dda4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:31:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lazy-loading 'flavor' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e24eb2-174c-4e88-b4bb-ea4069d41a49]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfIbgMzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:31:56 user nova-compute[75463]: INFO nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Booting with volume e8f95d95-9309-4431-a211-2f9d6cd6cfe2 at /dev/vdc
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Updated VIF entry in instance network info cache for port c700c96d-4e5a-49a1-8889-cbd40946303d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Updating instance_info_cache with network_info: [{"id": "c700c96d-4e5a-49a1-8889-cbd40946303d", "address": "fa:16:3e:d3:6a:0b", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc700c96d-4e", "ovs_interfaceid": "c700c96d-4e5a-49a1-8889-cbd40946303d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dee65851-8381-42d6-a4b6-d02a16edc973 req-7a9564b8-de84-4e74-b114-81dc3d527beb service nova] Releasing lock "refresh_cache-d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[52faafc1-030e-44ad-8b08-c6ab3491d2f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0632e659-2769-4c8f-ac0e-4ef34e42b2aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be3b18b-0c49-4d0a-ae07-e8cc2ad69387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6658f3e6-79b7-47ec-89cb-b4f046710305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:31:57 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8838e158-934a-4cf3-a053-5a6eab5fa4ab]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.utils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating existing volume attachment record: ccd1c581-a138-4d8a-aacd-0bead496447b {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:57 user nova-compute[75463]: INFO nova.compute.manager [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attaching volume 15a044ce-baca-4835-bbe9-480ef8795e46 to /dev/vdb
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:57 user nova-compute[75463]: INFO nova.compute.manager [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Attaching volume a8af3ad8-8537-42ab-b2ca-dfe39d252267 to /dev/vdb
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23539383030613535', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539383030613535', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG nova.objects.instance [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'flavor' on Instance uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:31:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:31:57 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:31:57 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:31:57 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:31:57 user nova-compute[75463]:   <serial>e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2</serial>
Nov 03 17:31:57 user nova-compute[75463]: </disk>
Nov 03 17:31:57 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No VIF found with MAC fa:16:3e:26:40:17, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-changed-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Refreshing instance network info cache due to event network-changed-1b4e3c7e-d09d-492f-9615-eea70a3106f6. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] Acquiring lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] Acquired lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Refreshing network info cache for port 1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updated VIF entry in instance network info cache for port 1b4e3c7e-d09d-492f-9615-eea70a3106f6. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating instance_info_cache with network_info: [{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-91c74ec3-2262-48ec-bb63-e80910ecec19 req-a4ae7400-6319-42d3-b21f-c467b80a7ee9 service nova] Releasing lock "refresh_cache-934190b6-f35a-4a1e-8e5e-3c76137f9f73" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:31:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:32:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7227MB free_disk=25.343151092529297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance affef3a2-57dd-421c-aaeb-7b2030a51246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7a12db62-26a6-47fa-906c-d92f67e08084 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:32:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:32:04 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:32:04 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:32:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:32:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTpzaUIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:09 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:09 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:09 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf5284-2b25-4a6b-afbc-3f85bd0cdc57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:09 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrPFisRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:09 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a10d46-0fd0-4938-a0f5-d574a072103d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c] added
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b19eaf-a719-4231-bf0d-6bd8bddc2c66]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed4de7-38fa-46ba-963d-55b3680e9337]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTpzaUIJ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTpzaUIJ" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c2ad1-cce9-4bf1-adbc-b756bfc42b16]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LTpzaUIJ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f11527-8243-4eac-9b80-d6ae5899b373]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28e1c1c-a964-4541-b247-35c5c92b83b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff382a-90e2-4d30-9cb1-64b5e6d9f031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260]
Nov 03 17:32:09 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-559805dc-9db2-4395-ac21-ce9bb970a377 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.798s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd5b873-ad60-4d7c-b609-f4c93eb2ac96]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd46075-3a54-40fb-8935-dc7f18ab5d32]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:09 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c5d6d-5d14-47d6-8db4-e838e2b9c6a6]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTpzaUIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[998241ec-5ef6-4cc8-850a-02968ecd6e52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b02ec6-3965-45c0-a199-79416cc35454]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9d4e4-160b-45db-8291-181920d19ba8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06b1ce-746e-4cef-8930-e33b410f1ef9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e72143-6d7b-4feb-87a5-1a69f2d9cd87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f8037-813a-45aa-acd0-c8fdd2d2dbfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dae1e-7f96-4d67-b03e-23b7ab4b9903]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updating existing volume attachment record: 0829ba9d-7d3c-437e-9327-23bd7f85f34a {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb80552a-2157-4ef1-b5a8-8804295adc21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752b180-5964-409e-bf39-c0df5c90a84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7520bcf-8558-4074-ab9d-7aca1d282bc4]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updating existing volume attachment record: d985a845-ef7e-4669-909e-14cc7c871a32 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43925e6-ae70-470e-90e3-df69fe9136ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[03643ace-07c8-47d5-bc64-b9686cad3e33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963dcee-7a3d-4627-addc-929f53a321d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcdccd6-b118-4cfb-ac84-efd15ba43b3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:10 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9175da2b-74ef-4f2a-afd9-427de9cb0752]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.utils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Updating existing volume attachment record: 9a0a6554-e464-4f71-ad7a-d24af7dc1924 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26463343463663537', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463343463663537', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:10 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:10 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e859db7-362b-49a6-825f-c6c105d68d7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:10 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:32:10 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:10 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:32:10 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:10 user nova-compute[75463]:   <serial>88af7a10-48aa-4ae7-a6cc-c02ed48af75c</serial>
Nov 03 17:32:10 user nova-compute[75463]: </disk>
Nov 03 17:32:10 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e93db-80e9-4011-a947-c7177d8b5ecf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192] added
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf320a-232b-42ea-aad9-824477d8df5f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20d1d0-54e8-47e4-8bfc-d9e85866038b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrPFisRg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrPFisRg" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e9233-2671-4735-ab76-0f15e9199c0f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrPFisRg'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce72447-de7f-4b17-960a-4fa2efdbfdd2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3339d3-9551-49a9-98f9-3e4555a366f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f36a4-45de-41f6-be3a-8b4be0af2b1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260]
Nov 03 17:32:10 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa54d339-e78d-4c7f-b257-87fce4147715]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9032975-c5b8-4024-96ea-8af1d54fc45f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:10 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e81652-d459-4a0e-92cf-c19eafde3beb]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrPFisRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No BDM found with device name hda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] No VIF found with MAC fa:16:3e:d6:09:cb, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] <== connect_volume: return (2669ms) {'type': 'block', 'scsi_wwn': '26364656333353765', 'path': '/dev/sde'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364656333353765', 'path': '/dev/sde'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.objects.instance [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lazy-loading 'flavor' on Instance uuid 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:32:12 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:12 user nova-compute[75463]:   <source dev="/dev/sde"/>
Nov 03 17:32:12 user nova-compute[75463]:   <target dev="sdc" bus="scsi"/>
Nov 03 17:32:12 user nova-compute[75463]:   <serial>c87e696c-adbb-4eb2-bef5-972c4705d192</serial>
Nov 03 17:32:12 user nova-compute[75463]:   <address type="drive" controller="0" unit="2"/>
Nov 03 17:32:12 user nova-compute[75463]: </disk>
Nov 03 17:32:12 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No BDM found with device name sda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] No VIF found with MAC fa:16:3e:af:0c:0d, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIfFhnQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:35 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:35 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:35 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331cb3e-7926-43ee-898b-e8ff12740765]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:35 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[350fea38-dbd9-4dd8-bf98-82ed128e8d07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267] added
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b764de-60f2-46dc-922c-2ec2ebaa12c9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e0966-8d14-40a5-9569-ee8eead08988]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIfFhnQg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIfFhnQg" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b73aa-e3ab-4436-bf35-e17765a1deae]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MIfFhnQg'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f838a94-5fde-4b22-927c-8e4c78069457]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55ba93-0ea3-4f8e-a7d1-46b51daec401]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3cccf-5b7d-42fc-a885-e36497a3440a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260]
Nov 03 17:32:35 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee054664-6362-4042-9b88-137fc9fb18e1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3f1787-4172-487a-8272-b1166b28c922]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:35 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2613b614-ca2d-4211-932b-9cc19df815ca tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 75.767s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415852e-f957-4ba1-ab7c-422018fb924c]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIfFhnQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bfda7008-a064-46e9-a19e-695fbafff842 tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 70.938s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:32:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Creating image(s)
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Ensure instance console log exists: /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Start _get_guest_xml network_info=[{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdzheoQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a12db62-26a6-47fa-906c-d92f67e08084', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 'serial': 'dc6b6d7a-fcf3-4107-a613-de6eb5ffb554'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '13aa0d03-6b36-4352-85c8-3e55623e1425', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPopRQzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a12db62-26a6-47fa-906c-d92f67e08084', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 'serial': 'd3c2be4e-e4ec-4b4a-a3ff-392d55ddf950'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'f7e9425b-d101-4deb-8a97-dedb46bb77b6', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEylPmgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7a12db62-26a6-47fa-906c-d92f67e08084', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 'serial': 'e8f95d95-9309-4431-a211-2f9d6cd6cfe2'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': 'ccd1c581-a138-4d8a-aacd-0bead496447b', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:32:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdzheoQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:35 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:35 user nova-compute[75463]: INFO nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Rebuilding instance
Nov 03 17:32:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:36 user nova-compute[75463]: WARNING nova.compute.manager [req-0bff52bd-729c-4c35-ba15-103da349c2bb req-406af634-7c28-4162-88a1-465bc561900b service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state rebuilding.
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26464333236383432', 'path': '/dev/sdf'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464333236383432', 'path': '/dev/sdf'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.721s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:36 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:36 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.objects.instance [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lazy-loading 'flavor' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a068249-6df2-47f9-91fe-957df12dc222]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:36 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] attach device xml: <disk type="block" device="disk">
Nov 03 17:32:36 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:36 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:32:36 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:36 user nova-compute[75463]:   <serial>a8af3ad8-8537-42ab-b2ca-dfe39d252267</serial>
Nov 03 17:32:36 user nova-compute[75463]: </disk>
Nov 03 17:32:36 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3567bfad-9c9f-4137-9e8f-f4da0f545238]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554] added
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f9cfe-c7a0-44d6-80f8-e58e2c2e2fd2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ed9a95-a8ee-46b5-96bb-9ee01705772b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EdzheoQC {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EdzheoQC" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5844cd2-6853-4480-9740-daaf68931012]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EdzheoQC'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8583e4f0-a36e-46bf-95f7-a4ac7acc0d33]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e3db69-daa6-4062-abad-1ede94663925]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:36 user nova-compute[75463]: INFO nova.compute.manager [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Detaching volume e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40cb3d4-6a3b-4ccb-9f04-94d0c72d78ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260]
Nov 03 17:32:36 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da85442-9697-473f-a7de-657ae74913ee]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: INFO nova.virt.block_device [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Attempting to driver detach volume e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 from mountpoint /dev/vdb
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0d778-a05a-414b-8a12-4e44de0a6d80]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:36 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Attempting to detach device vdb from instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:36 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:36 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:32:36 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:36 user nova-compute[75463]:   <serial>e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2</serial>
Nov 03 17:32:36 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:32:36 user nova-compute[75463]: </disk>
Nov 03 17:32:36 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0ad720-78aa-4a74-8fae-ef9348d1b395]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully detached device vdb from instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b from the persistent domain config.
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:32:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:36 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:36 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:32:36 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:36 user nova-compute[75463]:   <serial>e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2</serial>
Nov 03 17:32:36 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:32:36 user nova-compute[75463]: </disk>
Nov 03 17:32:36 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.compute.manager [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Detaching volume c87e696c-adbb-4eb2-bef5-972c4705d192
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance destroyed successfully.
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance destroyed successfully.
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471355234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.block_device [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Attempting to driver detach volume c87e696c-adbb-4eb2-bef5-972c4705d192 from mountpoint /dev/sdc
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b4e3c7e-d0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aebfa0ff-92bb-48dc-a73a-908072e1a396) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:37 user nova-compute[75463]: INFO os_vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0')
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:37 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] No VIF found with MAC fa:16:3e:8b:1c:e8, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Attempting to detach device sdc from instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:37 user nova-compute[75463]:   <source dev="/dev/sde"/>
Nov 03 17:32:37 user nova-compute[75463]:   <target dev="sdc" bus="scsi"/>
Nov 03 17:32:37 user nova-compute[75463]:   <serial>c87e696c-adbb-4eb2-bef5-972c4705d192</serial>
Nov 03 17:32:37 user nova-compute[75463]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 17:32:37 user nova-compute[75463]: </disk>
Nov 03 17:32:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Successfully detached device sdc from instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 from the persistent domain config.
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:37 user nova-compute[75463]:   <source dev="/dev/sde"/>
Nov 03 17:32:37 user nova-compute[75463]:   <target dev="sdc" bus="scsi"/>
Nov 03 17:32:37 user nova-compute[75463]:   <serial>c87e696c-adbb-4eb2-bef5-972c4705d192</serial>
Nov 03 17:32:37 user nova-compute[75463]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 03 17:32:37 user nova-compute[75463]: </disk>
Nov 03 17:32:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-62f2fb72-32a8-44db-a615-c81ac337b5d8 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.021s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.compute.manager [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Detaching volume 88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.block_device [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Attempting to driver detach volume 88af7a10-48aa-4ae7-a6cc-c02ed48af75c from mountpoint /dev/vdb
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Attempting to detach device vdb from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:37 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:32:37 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:37 user nova-compute[75463]:   <serial>88af7a10-48aa-4ae7-a6cc-c02ed48af75c</serial>
Nov 03 17:32:37 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 17:32:37 user nova-compute[75463]: </disk>
Nov 03 17:32:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully detached device vdb from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the persistent domain config.
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:37 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:32:37 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:37 user nova-compute[75463]:   <serial>88af7a10-48aa-4ae7-a6cc-c02ed48af75c</serial>
Nov 03 17:32:37 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 17:32:37 user nova-compute[75463]: </disk>
Nov 03 17:32:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] volume_snapshot_create: create_info: {'snapshot_id': 'f0402809-f670-4216-9c36-737909b1e2f4', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75463) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] snap xml: <domainsnapshot>
Nov 03 17:32:37 user nova-compute[75463]:   <disks>
Nov 03 17:32:37 user nova-compute[75463]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 03 17:32:37 user nova-compute[75463]:       <source file="/dev/new_file"/>
Nov 03 17:32:37 user nova-compute[75463]:     </disk>
Nov 03 17:32:37 user nova-compute[75463]:     <disk name="vda" snapshot="no"/>
Nov 03 17:32:37 user nova-compute[75463]:   </disks>
Nov 03 17:32:37 user nova-compute[75463]: </domainsnapshot>
Nov 03 17:32:37 user nova-compute[75463]:  {{(pid=75463) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] Lazy-loading 'system_metadata' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdzheoQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== connect_volume: return (2119ms) {'type': 'block', 'scsi_wwn': '23262393837386533', 'path': '/dev/sdg'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262393837386533', 'path': '/dev/sdg'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.693s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Traceback (most recent call last):
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     rv = execute(f, *args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     six.reraise(c, e, tb)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     raise value
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     rv = meth(*args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] 
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Traceback (most recent call last):
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     self._volume_snapshot_create(context, instance, guest,
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     rv = execute(f, *args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     six.reraise(c, e, tb)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     raise value
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     rv = meth(*args, **kwargs)
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] 
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9aa36f-e7be-439b-93a1-8d015fa9e6a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-015100a1-62b8-4860-a256-3f5e9853c055 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] volume_snapshot_delete: delete_info: {'volume_id': 'a8af3ad8-8537-42ab-b2ca-dfe39d252267'} {{(pid=75463) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [None req-015100a1-62b8-4860-a256-3f5e9853c055 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Traceback (most recent call last):
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246]     if delete_info['type'] != 'qcow2':
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] KeyError: 'type'
Nov 03 17:32:37 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] 
Nov 03 17:32:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPopRQzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:37 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:37 user nova-compute[75463]: No targets found.
Nov 03 17:32:37 user nova-compute[75463]: iSNS:
Nov 03 17:32:37 user nova-compute[75463]: No targets found.
Nov 03 17:32:37 user nova-compute[75463]: STATIC:
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:37 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:37 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:37 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:37 user nova-compute[75463]: No targets found.
Nov 03 17:32:37 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:37 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:37 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96d5761-2534-4f61-8358-87dd2a3c8275]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362556d-1df5-44c1-8341-b7d69eea714e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec60ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f0402809-f670-4216-9c36-737909b1e2f4 could not be found.
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise value
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f0402809-f670-4216-9c36-737909b1e2f4 could not be found. (HTTP 404) (Request-ID: req-353e7cfe-2eb5-4241-b8ad-9fe2716ccb4e)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f0402809-f670-4216-9c36-737909b1e2f4 could not be found.
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bca7b8-fa68-45c8-8b40-f19b5db52c01]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver [None req-015100a1-62b8-4860-a256-3f5e9853c055 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-13203723-aa80-40d0-baaa-6a4e1ea250d7)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 03 17:32:38 user nova-compute[75463]: ERROR nova.virt.libvirt.driver 
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-e06654cf-1a52-4582-821f-7b749b9b6a36 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise value
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79a432-a6ce-4949-8ab5-d7d15f3f610a]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-015100a1-62b8-4860-a256-3f5e9853c055 tempest-VolumesAssistedSnapshotsTest-883381854 tempest-VolumesAssistedSnapshotsTest-883381854-project] Exception during message handling: KeyError: 'type'
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 03 17:32:38 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e925eb-f723-49f7-b745-bcdf0737a82d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d83af73-e3b9-47c2-ad3d-1adaddfd07e3]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb09b1-5a19-4fbf-b02e-2eb304135d3b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb76212-794f-4755-b173-643de2d82c20]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]
Nov 03 17:32:38 user nova-compute[75463]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1fb6cc-a7dd-4654-a64c-e3c85af0fcb2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== disconnect_volume: return (1068ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deleting instance files /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73_del
Nov 03 17:32:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deletion of /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73_del complete
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.318s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:38 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b77aa-f851-4c2b-9c1c-5e3e2a668c92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:38 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635ca35-e712-4f7d-b5e8-c62e92c7cb58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950] added
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:38 user nova-compute[75463]: INFO nova.compute.manager [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Detaching volume a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[76684eb3-5f6b-4ec8-91df-fce4927ac5bc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efd0dd1-2871-410e-b9df-69b77bf88640]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPopRQzO {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPopRQzO" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3fae05-4f9e-42f6-ab36-e9e23108c1d6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPopRQzO'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: INFO nova.virt.block_device [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Attempting to driver detach volume a8af3ad8-8537-42ab-b2ca-dfe39d252267 from mountpoint /dev/vdb
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Attempting to detach device vdb from instance affef3a2-57dd-421c-aaeb-7b2030a51246 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:38 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:38 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:32:38 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:38 user nova-compute[75463]:   <serial>a8af3ad8-8537-42ab-b2ca-dfe39d252267</serial>
Nov 03 17:32:38 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:32:38 user nova-compute[75463]: </disk>
Nov 03 17:32:38 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54567e0-8c1b-410d-bb31-d33f7e86524e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Successfully detached device vdb from instance affef3a2-57dd-421c-aaeb-7b2030a51246 from the persistent domain config.
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance affef3a2-57dd-421c-aaeb-7b2030a51246 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] detach device xml: <disk type="block" device="disk">
Nov 03 17:32:38 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:38 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:32:38 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:38 user nova-compute[75463]:   <serial>a8af3ad8-8537-42ab-b2ca-dfe39d252267</serial>
Nov 03 17:32:38 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:32:38 user nova-compute[75463]: </disk>
Nov 03 17:32:38 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da670eff-eb70-4a8c-b8da-734be071796d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.compute.manager [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.compute.manager [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:38 user nova-compute[75463]: WARNING nova.compute.manager [req-257e253a-f118-46cf-99b9-dddb3503385e req-a2858dbc-a6e9-4270-a440-ccbc6f4fb98f service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state rebuilding.
Nov 03 17:32:38 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 could not be found.
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[770dfab9-f96b-4cc3-9ef0-19b16a5abaf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260]
Nov 03 17:32:38 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a94ab18-f013-4d6a-bc43-c3a82ed95769]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56373012-269a-43f1-911b-9d3e0b63001c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0029a86-aa78-4066-a400-481be88c9a0a]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPopRQzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== connect_volume: return (1686ms) {'type': 'block', 'scsi_wwn': '23961333334626130', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333334626130', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.123s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac57bc6-cea4-48f3-bc0e-28cf84726554]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:39 user nova-compute[75463]: No targets found.
Nov 03 17:32:39 user nova-compute[75463]: iSNS:
Nov 03 17:32:39 user nova-compute[75463]: No targets found.
Nov 03 17:32:39 user nova-compute[75463]: STATIC:
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:32:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:39 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:39 user nova-compute[75463]: No targets found.
Nov 03 17:32:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:39 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:39 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEylPmgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b587d8f-87b3-4192-a06b-6ca24d455ea2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d357ec9-7aeb-4e60-9a6c-fe5e5f0b83e4]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec59c820>, {}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Disconnecting from: [] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== disconnect_volume: return (1209ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.051s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:39 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbd8eb-a74c-470a-98f4-b1d2b83f3024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:39 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5e507-9c0a-4c18-af76-8c1a589b7e89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2] added
Nov 03 17:32:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.082s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[23050a57-6d84-4dd5-aae7-cf0f85342edb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.054s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd34735-af90-41fa-ab92-061850347fbb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEylPmgw {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEylPmgw" returned: 0 in 0.074s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c3169a-a7a6-49bc-bb61-e0c24eb8ab0a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEylPmgw'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb30f8e-cd61-4cda-8508-8c2e417cdefc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf804d-a578-47b5-ba34-d0635fd0f22e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62684b02-72fd-4e6d-8eb7-3c036bdb06a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260]
Nov 03 17:32:40 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcffc02-4fee-4dc7-b281-d3b55f566dc1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b167fb8a-7595-4d7f-87c0-2e084ff11b25]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.460s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[16936998-74d5-40f1-83e8-294767ef8c5b]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEylPmgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Preparing to wait for external event volume-reimaged-5f8552c3-a6cd-4a56-8643-c73eef62e850 {{(pid=75463) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.volume.cinder [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Update attachment failed for attachment 9a0a6554-e464-4f71-ad7a-d24af7dc1924. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Traceback (most recent call last):
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     driver_block_device.attach_block_devices(
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     _log_and_attach(device)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     super(DriverVolBlankBlockDevice, self).attach(
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     connection_info = volume_api.attachment_update(
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     with excutils.save_and_reraise_exception():
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     self.force_reraise()
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     raise self.value
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     return method.func(obj, *args, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     return self.request(url, method, **kwargs)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435]     raise exceptions.from_response(resp, body)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1)
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] 
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.claims [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Aborting claim: <nova.compute.claims.Claim object at 0x7fe00c3654b0> {{(pid=75463) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '23664343361633765', 'path': '/dev/sdh'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664343361633765', 'path': '/dev/sdh'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a12db62-26a6-47fa-906c-d92f67e08084 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:32:41 user nova-compute[75463]:   <uuid>7a12db62-26a6-47fa-906c-d92f67e08084</uuid>
Nov 03 17:32:41 user nova-compute[75463]:   <name>instance-0000000c</name>
Nov 03 17:32:41 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:32:41 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:32:41 user nova-compute[75463]:   <metadata>
Nov 03 17:32:41 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:32:41 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:name>tempest-device-tagging-server-903351217</nova:name>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:32:35</nova:creationTime>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:32:41 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:32:41 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:owner>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:user uuid="bb7e9c88f7ab4fb7b205452ec24c75f3">tempest-TaggedBootDevicesTest_v242-960766363-project-member</nova:user>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:project uuid="a9a0d997a83745debe050f94c1896711">tempest-TaggedBootDevicesTest_v242-960766363</nova:project>
Nov 03 17:32:41 user nova-compute[75463]:       </nova:owner>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:32:41 user nova-compute[75463]:       <nova:ports>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="5f9b73f9-a93e-48f3-bbef-0be495c7e08a">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="88afdc4c-f0ce-41f0-80ec-91d526a8329f">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="8076f1d6-eb6d-4430-b601-1aad292f8cb2">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="ffa18fac-3162-43af-a550-254a6e897464">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="769ebb0a-75f2-4063-8537-e36895b29b22">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="d405e3ff-75b9-4ef2-8071-08751d53f470">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:         <nova:port uuid="a16f54e0-444b-4e24-8bab-162e0d3fb29e">
Nov 03 17:32:41 user nova-compute[75463]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 17:32:41 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:41 user nova-compute[75463]:       </nova:ports>
Nov 03 17:32:41 user nova-compute[75463]:     </nova:instance>
Nov 03 17:32:41 user nova-compute[75463]:   </metadata>
Nov 03 17:32:41 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:32:41 user nova-compute[75463]:     <system>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="serial">7a12db62-26a6-47fa-906c-d92f67e08084</entry>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="uuid">7a12db62-26a6-47fa-906c-d92f67e08084</entry>
Nov 03 17:32:41 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:32:41 user nova-compute[75463]:     </system>
Nov 03 17:32:41 user nova-compute[75463]:   </sysinfo>
Nov 03 17:32:41 user nova-compute[75463]:   <os>
Nov 03 17:32:41 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:32:41 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:32:41 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:32:41 user nova-compute[75463]:   </os>
Nov 03 17:32:41 user nova-compute[75463]:   <features>
Nov 03 17:32:41 user nova-compute[75463]:     <acpi/>
Nov 03 17:32:41 user nova-compute[75463]:     <apic/>
Nov 03 17:32:41 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:32:41 user nova-compute[75463]:   </features>
Nov 03 17:32:41 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:32:41 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:32:41 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:32:41 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:32:41 user nova-compute[75463]:   </clock>
Nov 03 17:32:41 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:32:41 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:32:41 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:32:41 user nova-compute[75463]:   </cpu>
Nov 03 17:32:41 user nova-compute[75463]:   <devices>
Nov 03 17:32:41 user nova-compute[75463]:     <disk type="file" device="cdrom">
Nov 03 17:32:41 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 17:32:41 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/disk.config"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="hda" bus="ide"/>
Nov 03 17:32:41 user nova-compute[75463]:     </disk>
Nov 03 17:32:41 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:32:41 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:41 user nova-compute[75463]:       <source dev="/dev/sdg"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <serial>dc6b6d7a-fcf3-4107-a613-de6eb5ffb554</serial>
Nov 03 17:32:41 user nova-compute[75463]:     </disk>
Nov 03 17:32:41 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:32:41 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:41 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <serial>d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950</serial>
Nov 03 17:32:41 user nova-compute[75463]:     </disk>
Nov 03 17:32:41 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:32:41 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:41 user nova-compute[75463]:       <source dev="/dev/sdh"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="vdc" bus="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <serial>e8f95d95-9309-4431-a211-2f9d6cd6cfe2</serial>
Nov 03 17:32:41 user nova-compute[75463]:     </disk>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:ea:9d:b7"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tap5f9b73f9-a9"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:17:62:6b"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tap88afdc4c-f0"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:cb:cd:c0"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tap8076f1d6-eb"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:5c:86:d1"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tapffa18fac-31"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:5f:b6:fc"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tap769ebb0a-75"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:e4:5a:97"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tapd405e3ff-75"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:41 user nova-compute[75463]:       <mac address="fa:16:3e:b0:00:b6"/>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:41 user nova-compute[75463]:       <target dev="tapa16f54e0-44"/>
Nov 03 17:32:41 user nova-compute[75463]:     </interface>
Nov 03 17:32:41 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:32:41 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/console.log" append="off"/>
Nov 03 17:32:41 user nova-compute[75463]:     </serial>
Nov 03 17:32:41 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:32:41 user nova-compute[75463]:     <video>
Nov 03 17:32:41 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:41 user nova-compute[75463]:     </video>
Nov 03 17:32:41 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:32:41 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:32:41 user nova-compute[75463]:     </rng>
Nov 03 17:32:41 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:32:41 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:32:41 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:32:41 user nova-compute[75463]:     </memballoon>
Nov 03 17:32:41 user nova-compute[75463]:   </devices>
Nov 03 17:32:41 user nova-compute[75463]: </domain>
Nov 03 17:32:41 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c03e20b-f541-5b26-90b7-2aac372bc1de', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9b73f9-a9, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f9b73f9-a9, col_values=(('qos', UUID('651efe5a-4671-44fc-a1e2-080dd918f8c1')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f9b73f9-a9, col_values=(('external_ids', {'iface-id': '5f9b73f9-a93e-48f3-bbef-0be495c7e08a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:9d:b7', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '796aaea8-4967-509f-aaed-52b81e738ee6', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88afdc4c-f0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88afdc4c-f0, col_values=(('qos', UUID('8bc18a8d-fea1-40f2-b134-609af8ab837d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88afdc4c-f0, col_values=(('external_ids', {'iface-id': '88afdc4c-f0ce-41f0-80ec-91d526a8329f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:62:6b', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d07da9e-7aba-5495-bbaa-018b91287f09', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8076f1d6-eb, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8076f1d6-eb, col_values=(('qos', UUID('70a57f68-beae-4566-8330-880ff9eb0992')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8076f1d6-eb, col_values=(('external_ids', {'iface-id': '8076f1d6-eb6d-4430-b601-1aad292f8cb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:cd:c0', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce0fab39-7234-5b4a-9b51-65623f9bcdb6', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffa18fac-31, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffa18fac-31, col_values=(('qos', UUID('58a1ed6d-1755-44d1-91c8-0275683ffdf6')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffa18fac-31, col_values=(('external_ids', {'iface-id': 'ffa18fac-3162-43af-a550-254a6e897464', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:86:d1', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b1b3534-1349-5a53-b205-2d7736bb009b', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap769ebb0a-75, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap769ebb0a-75, col_values=(('qos', UUID('8347f60c-a2fc-42b3-b220-609e810ca7e4')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap769ebb0a-75, col_values=(('external_ids', {'iface-id': '769ebb0a-75f2-4063-8537-e36895b29b22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:b6:fc', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.463s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Build of instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1) {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.utils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Build of instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75463) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 03 17:32:41 user nova-compute[75463]: ERROR nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Build of instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1): nova.exception.BuildAbortException: Build of instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bccfcb49-1a27-4532-9ee0-c33eea8d43c1)
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Unplugging VIFs for instance {{(pid=75463) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:31:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1664695457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1664695457',id=13,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-f1ivvkpo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:31:55Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=d5a95d50-fabb-4fb1-b8c2-f9d943c5b435,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c700c96d-4e5a-49a1-8889-cbd40946303d", "address": "fa:16:3e:d3:6a:0b", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc700c96d-4e", "ovs_interfaceid": "c700c96d-4e5a-49a1-8889-cbd40946303d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "c700c96d-4e5a-49a1-8889-cbd40946303d", "address": "fa:16:3e:d3:6a:0b", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc700c96d-4e", "ovs_interfaceid": "c700c96d-4e5a-49a1-8889-cbd40946303d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6a:0b,bridge_name='br-int',has_traffic_filtering=True,id=c700c96d-4e5a-49a1-8889-cbd40946303d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc700c96d-4e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6a:0b,bridge_name='br-int',has_traffic_filtering=True,id=c700c96d-4e5a-49a1-8889-cbd40946303d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc700c96d-4e') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc700c96d-4e, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69b71afb-14b6-57ec-ad61-93b5ae42ed76', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6a:0b,bridge_name='br-int',has_traffic_filtering=True,id=c700c96d-4e5a-49a1-8889-cbd40946303d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc700c96d-4e')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Unplugged VIFs for instance {{(pid=75463) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd405e3ff-75, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd405e3ff-75, col_values=(('qos', UUID('870496a0-87a0-49f4-8c13-51e845abb8fe')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd405e3ff-75, col_values=(('external_ids', {'iface-id': 'd405e3ff-75b9-4ef2-8071-08751d53f470', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5a:97', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdb1ab35-9d27-50ea-b99b-3849288df7c2', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa16f54e0-44, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa16f54e0-44, col_values=(('qos', UUID('95816240-ff15-4b5f-ae41-0e0ba64434a0')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa16f54e0-44, col_values=(('external_ids', {'iface-id': 'a16f54e0-444b-4e24-8bab-162e0d3fb29e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:00:b6', 'vm-uuid': '7a12db62-26a6-47fa-906c-d92f67e08084'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:41 user nova-compute[75463]: INFO os_vif [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44')
Nov 03 17:32:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] No BDM found with device name hda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] No VIF found with MAC fa:16:3e:ea:9d:b7, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] No VIF found with MAC fa:16:3e:5f:b6:fc, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Using config drive
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.network.neutron [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:32:42 user nova-compute[75463]: INFO nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Took 0.49 seconds to deallocate network for instance.
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Detaching volume: 25c7b3dd-1ce9-408e-8a34-90f9b7710467 {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 03 17:32:42 user nova-compute[75463]: INFO nova.compute.manager [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Detaching volume 25c7b3dd-1ce9-408e-8a34-90f9b7710467
Nov 03 17:32:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Creating config drive at /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/disk.config
Nov 03 17:32:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5dv4bccr {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5dv4bccr" returned: 0 in 0.063s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:42 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: d5a95d50-fabb-4fb1-b8c2-f9d943c5b435] Skipping driver_detach during remote rebuild. {{(pid=75463) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 03 17:32:42 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Deleted allocations for instance d5a95d50-fabb-4fb1-b8c2-f9d943c5b435
Nov 03 17:32:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30f683dc-ff25-4831-a1e1-04038e3fc79a tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "d5a95d50-fabb-4fb1-b8c2-f9d943c5b435" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.656s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:44 user nova-compute[75463]: WARNING nova.compute.manager [req-47e8bf6f-87b0-4e28-98fd-e8600b674343 req-d668b074-a793-4229-96bb-f18b806b02c2 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a for instance with vm_state building and task_state spawning.
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:44 user nova-compute[75463]: WARNING nova.compute.manager [req-50efc67a-1089-4dfd-9cc7-c5a557542aa4 req-49533228-735c-41a7-b082-3cfef8f99438 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f for instance with vm_state building and task_state spawning.
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:44 user nova-compute[75463]: WARNING nova.compute.manager [req-adf2c070-e3e0-41fb-9c8e-79062554f52b req-19563495-4ed8-40c0-a68e-53c1899bbfc6 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 for instance with vm_state building and task_state spawning.
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:45 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:45 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:45 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[defedd68-25e0-4afd-858a-9640d9917d97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:32:45 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a415d-ac8d-4615-9b7c-b39756e1a197]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46] added
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fcfe65-f5f0-45bb-9061-e0a3d95e61de]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae5682-72d7-4b4f-85a4-1b68b678e5bd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfBysQOK {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfBysQOK" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f41db-76de-4210-ad4c-8b7b9d44b723]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfBysQOK'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f660056-33bf-49eb-bb66-fedc915adf1b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[207197ff-170d-45ba-ae80-45677348f70c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670b878-4935-4847-8fab-a057fe6083a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]
Nov 03 17:32:45 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[066103a7-0f1c-4ee8-a6db-3b61ad992bcd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c928dda-4c15-44c7-a1de-1b8cc91fecab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764802c-a086-4491-9c4f-f627d30f7589]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-3af1c020-c5cc-455e-acac-4407ec29f1bf req-f35230cc-c528-4395-a770-d10fd502145d service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-15258657-7a7c-4754-80ad-705917f48125 req-77a7a572-2cb0-4db4-bdb1-e6fa11b7eb32 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:32:46 user nova-compute[75463]: INFO nova.compute.claims [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Claim successful on node user
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:46 user nova-compute[75463]: WARNING nova.compute.manager [req-7b9a234e-6d90-4d8c-9431-7ffcbc55166d req-0d3318da-bd52-4227-b8fa-223fb53c2839 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 for instance with vm_state building and task_state spawning.
Nov 03 17:32:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23332306634333733', 'path': '/dev/sdi'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332306634333733', 'path': '/dev/sdi'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lazy-loading 'flavor' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:32:46 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:32:46 user nova-compute[75463]:   <source dev="/dev/sdi"/>
Nov 03 17:32:46 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:32:46 user nova-compute[75463]:   <serial>15a044ce-baca-4835-bbe9-480ef8795e46</serial>
Nov 03 17:32:46 user nova-compute[75463]: </disk>
Nov 03 17:32:46 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] No VIF found with MAC fa:16:3e:79:ba:68, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:32:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5840c6cf-9edd-4b01-ae93-8e6f546c8aee tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.245s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.policy [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5c6f094b0c423ea22b458b0beecb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b9a3c05c7147b88d7814833b87d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:32:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Creating image(s)
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "/opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk 1073741824" returned: 0 in 0.058s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:32:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance spawned successfully.
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Successfully created port: ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:48 user nova-compute[75463]: WARNING nova.compute.manager [req-101fc76f-8bf1-4c81-a64d-13e51e1148da req-101d4937-040a-4bff-9dfc-272b2c95dc94 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e for instance with vm_state building and task_state spawning.
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Cannot resize image /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Ensure instance console log exists: /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:48 user nova-compute[75463]: INFO nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:32:48 user nova-compute[75463]: INFO nova.compute.manager [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Took 126.13 seconds to build instance.
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0e80ab7d-02f8-4c24-a2d3-ca1c9ad43f6a tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 126.231s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:48 user nova-compute[75463]: WARNING nova.compute.manager [req-816286d8-844c-4925-92e2-765774d75610 req-837eb4d5-759d-4a43-8435-f360bd97c8a5 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 for instance with vm_state active and task_state None.
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.utils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9ed8f-cef4-423e-bf0c-b369bd81d8d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c4cb2-bea2-4cc7-84d9-f77cd5e1b4a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e4b5e6-44f4-43b5-9b7c-43da915a225f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4161c0-c8fd-499e-890d-67b5039b7ca1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:49 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac7e6c-e430-46c4-b471-7722ce16d3d3]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG os_brick.utils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:49 user nova-compute[75463]: INFO nova.compute.manager [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Swapping volume 15a044ce-baca-4835-bbe9-480ef8795e46 for 7aa990b6-745f-4c6d-9121-a2720d84e8a4
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Successfully updated port: ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updating instance_info_cache with network_info: [{"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Instance network_info: |[{"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Start _get_guest_xml network_info=[{"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:32:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421658913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421658913',id=14,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-lajy5udt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:32:47Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=263ef766-2fbd-4277-b464-2b654a5029ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:49 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'pci_devices' on Instance uuid 263ef766-2fbd-4277-b464-2b654a5029ee {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:32:50 user nova-compute[75463]:   <uuid>263ef766-2fbd-4277-b464-2b654a5029ee</uuid>
Nov 03 17:32:50 user nova-compute[75463]:   <name>instance-0000000e</name>
Nov 03 17:32:50 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:32:50 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:32:50 user nova-compute[75463]:   <metadata>
Nov 03 17:32:50 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:32:50 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1421658913</nova:name>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:32:49</nova:creationTime>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:32:50 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:32:50 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:owner>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:user uuid="bd5c6f094b0c423ea22b458b0beecb15">tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member</nova:user>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:project uuid="06b9a3c05c7147b88d7814833b87d157">tempest-ServerBootFromVolumeStableRescueTest-2042988048</nova:project>
Nov 03 17:32:50 user nova-compute[75463]:       </nova:owner>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:32:50 user nova-compute[75463]:       <nova:ports>
Nov 03 17:32:50 user nova-compute[75463]:         <nova:port uuid="ab4155fb-62db-4d00-91a3-ad414800259e">
Nov 03 17:32:50 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:32:50 user nova-compute[75463]:         </nova:port>
Nov 03 17:32:50 user nova-compute[75463]:       </nova:ports>
Nov 03 17:32:50 user nova-compute[75463]:     </nova:instance>
Nov 03 17:32:50 user nova-compute[75463]:   </metadata>
Nov 03 17:32:50 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:32:50 user nova-compute[75463]:     <system>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="serial">263ef766-2fbd-4277-b464-2b654a5029ee</entry>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="uuid">263ef766-2fbd-4277-b464-2b654a5029ee</entry>
Nov 03 17:32:50 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:32:50 user nova-compute[75463]:     </system>
Nov 03 17:32:50 user nova-compute[75463]:   </sysinfo>
Nov 03 17:32:50 user nova-compute[75463]:   <os>
Nov 03 17:32:50 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:32:50 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:32:50 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:32:50 user nova-compute[75463]:   </os>
Nov 03 17:32:50 user nova-compute[75463]:   <features>
Nov 03 17:32:50 user nova-compute[75463]:     <acpi/>
Nov 03 17:32:50 user nova-compute[75463]:     <apic/>
Nov 03 17:32:50 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:32:50 user nova-compute[75463]:   </features>
Nov 03 17:32:50 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:32:50 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:32:50 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:32:50 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:32:50 user nova-compute[75463]:   </clock>
Nov 03 17:32:50 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:32:50 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:32:50 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:32:50 user nova-compute[75463]:   </cpu>
Nov 03 17:32:50 user nova-compute[75463]:   <devices>
Nov 03 17:32:50 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:32:50 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:32:50 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk"/>
Nov 03 17:32:50 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:32:50 user nova-compute[75463]:     </disk>
Nov 03 17:32:50 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:32:50 user nova-compute[75463]:       <mac address="fa:16:3e:5f:cc:17"/>
Nov 03 17:32:50 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:50 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:32:50 user nova-compute[75463]:       <target dev="tapab4155fb-62"/>
Nov 03 17:32:50 user nova-compute[75463]:     </interface>
Nov 03 17:32:50 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:32:50 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/console.log" append="off"/>
Nov 03 17:32:50 user nova-compute[75463]:     </serial>
Nov 03 17:32:50 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:32:50 user nova-compute[75463]:     <video>
Nov 03 17:32:50 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:32:50 user nova-compute[75463]:     </video>
Nov 03 17:32:50 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:32:50 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:32:50 user nova-compute[75463]:     </rng>
Nov 03 17:32:50 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:32:50 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:32:50 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:32:50 user nova-compute[75463]:     </memballoon>
Nov 03 17:32:50 user nova-compute[75463]:   </devices>
Nov 03 17:32:50 user nova-compute[75463]: </domain>
Nov 03 17:32:50 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421658913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421658913',id=14,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-lajy5udt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:32:47Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=263ef766-2fbd-4277-b464-2b654a5029ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG os_vif [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e1f87d7-e430-5bdd-9e3d-f7cdaead9aca', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab4155fb-62, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab4155fb-62, col_values=(('qos', UUID('4ee71f1e-dddb-4a76-87fe-3c9a4e5a6c4b')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab4155fb-62, col_values=(('external_ids', {'iface-id': 'ab4155fb-62db-4d00-91a3-ad414800259e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:cc:17', 'vm-uuid': '263ef766-2fbd-4277-b464-2b654a5029ee'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:50 user nova-compute[75463]: INFO os_vif [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62')
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No VIF found with MAC fa:16:3e:5f:cc:17, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-changed-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Refreshing instance network info cache due to event network-changed-ab4155fb-62db-4d00-91a3-ad414800259e. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] Acquiring lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] Acquired lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:32:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Refreshing network info cache for port ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updated VIF entry in instance network info cache for port ab4155fb-62db-4d00-91a3-ad414800259e. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updating instance_info_cache with network_info: [{"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0630150a-f4ec-44c1-88f4-44f8c2b51847 req-7e47d35a-4f2e-4d49-9849-6b76adc6b639 service nova] Releasing lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG nova.objects.instance [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lazy-loading 'flavor' on Instance uuid 8068fdfb-ac16-4213-8152-885a91e37616 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:51 user nova-compute[75463]: INFO nova.compute.manager [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Attaching volume bc28a99f-c1dd-4c1b-9ac8-3f5d6e3fedf1 to /dev/vdb
Nov 03 17:32:51 user nova-compute[75463]: DEBUG os_brick.utils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0617cc31-d31e-43a0-a691-ea6e75cae442]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7eb682-f03b-4d91-abfb-005ee3c938d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e55eafb-51bb-4bf8-ad81-f446e6035e98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ec315-f84f-40b8-be7b-8be71a296987]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:32:52 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c8a9e-82a5-4c85-a528-945dfff3261a]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG os_brick.utils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating existing volume attachment record: 0d8594a9-221c-438c-b6b7-d0d24fe3ecdd {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] No waiting events found dispatching network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:52 user nova-compute[75463]: WARNING nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received unexpected event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e for instance with vm_state building and task_state spawning.
Nov 03 17:32:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] No waiting events found dispatching network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:32:52 user nova-compute[75463]: WARNING nova.compute.manager [req-004ed954-f982-4aee-a948-dfe8ac4b88f8 req-d527acf5-3d09-4b70-9705-1b44208bb5e0 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received unexpected event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e for instance with vm_state building and task_state spawning.
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:32:54 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Instance spawned successfully.
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:32:54 user nova-compute[75463]: INFO nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 03 17:32:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:32:54 user nova-compute[75463]: INFO nova.compute.manager [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Took 7.84 seconds to build instance.
Nov 03 17:32:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5d988d63-589a-4f75-9d21-306aaa630b89 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.991s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:32:55 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b is timed out.
Nov 03 17:32:57 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully detached device vdb from instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b from the live domain config.
Nov 03 17:32:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfIbgMzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:57 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9431926-7fd8-47f1-af64-10e90ba1e25b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]: iSNS:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]: STATIC:
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:57 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:57 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1cc58e-9c3e-4e01-bf4f-ccf617b1fbf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[32920e84-566f-47a6-971d-865b6323ef42]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c4e7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46add2a-b65c-475b-82da-d1a5a742e4ff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5eebe0-0148-4941-83d0-f677d99adf1f]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a0fca-d607-46c3-be32-9864436a3531]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a2043-0237-4c18-86cf-d2c5ea9a3139]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa215865-4d70-4863-8ba4-6c1f233782cc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 is timed out.
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7afb32-2252-4a10-a852-b4331fc2c99a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260]
Nov 03 17:32:57 user nova-compute[75463]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:57 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Successfully detached device sdc from instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 from the live domain config.
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dea03c-8eb9-4ea3-98d2-342e3b18d9d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c437f6-475e-4fd6-bebb-f8e1bb3eff68]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] <== disconnect_volume: return (396ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrPFisRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:57 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75cb22c-bc54-4880-b73c-36382df84bac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]: iSNS:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]: STATIC:
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:32:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:57 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:57 user nova-compute[75463]: No targets found.
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:57 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:57 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302a331-6f54-4ce0-ad18-b16dd696b361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e058f3-d730-4ade-b910-64b9d94b51af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec422a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192'): ({'sde'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Removing single pathed devices sde {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5dfb85-3b18-4c36-ac00-c2f5376c2964]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7137cc-d04d-4acb-8130-1972280e16e0]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Flushing IO for device /dev/sde {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[27603746-98f2-4c44-b87d-2bbcd8b0ff61]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da0253-3fc9-4d92-83a0-29eeec30f730]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 is timed out.
Nov 03 17:32:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully detached device vdb from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the live domain config.
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTpzaUIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b70a956-a298-41b7-9fa5-3c83295cbd1b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeaa354-bbe5-44b3-a675-3b90b9805c4d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260]
Nov 03 17:32:58 user nova-compute[75463]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c87e696c-adbb-4eb2-bef5-972c4705d192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[243766cf-e7c0-44dd-95b3-f0d3ee1d5676]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] <== disconnect_volume: return (455ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.171s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4128f4e-833e-48ff-ba6f-a6fa9a6f6afa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:58 user nova-compute[75463]: No targets found.
Nov 03 17:32:58 user nova-compute[75463]: iSNS:
Nov 03 17:32:58 user nova-compute[75463]: No targets found.
Nov 03 17:32:58 user nova-compute[75463]: STATIC:
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:32:58 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:58 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:58 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:58 user nova-compute[75463]: No targets found.
Nov 03 17:32:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:58 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:58 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.043s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10a47a-656b-4620-80aa-fe8230b94ae7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c8ca2b-0f30-4719-a022-16ea2442c15b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe018e8c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c1c899-2bfa-4a17-b0f6-961e54601fc5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9456c3b6-4125-44da-b444-3a434bd71697]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f840f351-b191-4d38-92ad-2fb360c170f5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d793c12-d4ff-4ae0-935c-b140308d77ba]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdba55f7-b2d5-4be4-85f4-e29072b34b04]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d6a48-9749-4682-a5dd-dd7fb243b534]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260]
Nov 03 17:32:58 user nova-compute[75463]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88af7a10-48aa-4ae7-a6cc-c02ed48af75c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967da8b-be3d-4fd9-9fb0-5c14090d6f63]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] <== disconnect_volume: return (573ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance affef3a2-57dd-421c-aaeb-7b2030a51246 is timed out.
Nov 03 17:32:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Successfully detached device vdb from instance affef3a2-57dd-421c-aaeb-7b2030a51246 from the live domain config.
Nov 03 17:32:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIfFhnQg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:32:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:32:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.089s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[60771a4a-2520-451e-8532-7d7bec0455dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:32:59 user nova-compute[75463]: No targets found.
Nov 03 17:32:59 user nova-compute[75463]: iSNS:
Nov 03 17:32:59 user nova-compute[75463]: No targets found.
Nov 03 17:32:59 user nova-compute[75463]: STATIC:
Nov 03 17:32:59 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:32:59 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:59 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:59 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:32:59 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:59 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:59 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:32:59 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:59 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:59 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267
Nov 03 17:32:59 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:59 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:59 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:32:59 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:32:59 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:32:59 user nova-compute[75463]: FIRMWARE:
Nov 03 17:32:59 user nova-compute[75463]: No targets found.
Nov 03 17:32:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:32:59 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:32:59 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c30d7-1033-49ba-b2ad-8f23d1f4871c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a0b559-6188-46c3-b810-c1ee5d800095]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:32:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec59fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267'): ({'sdf'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Removing single pathed devices sdf {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ece715-a5fa-4b77-ba98-c48765f4f1df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e10fe0-03d7-4c93-a01d-01f8b15cf874]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Flushing IO for device /dev/sdf {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a3fae-ba03-4a22-8cb7-a04a3be4ece6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.154s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abcb6c-c97d-4bb2-94ed-2e81619947f3]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] SCSI volumes sdf have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1f14a-ece5-42c5-ab23-bfecaf0347f2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[86823088-8c86-4f3b-a340-ee04094f23f5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260]
Nov 03 17:32:59 user nova-compute[75463]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267, portal: 172.16.0.220,3260] successful.
Nov 03 17:32:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8af3ad8-8537-42ab-b2ca-dfe39d252267 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63fdcd5-5793-47d3-8656-d1e6615eb350]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.601s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] <== disconnect_volume: return (606ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:32:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:33:01 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:01 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.321109771728516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance affef3a2-57dd-421c-aaeb-7b2030a51246 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7a12db62-26a6-47fa-906c-d92f67e08084 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:33:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:33:02 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:33:02 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:33:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:33:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG nova.objects.instance [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'flavor' on Instance uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-01302444-2d01-47d6-9a9c-932084232192 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.053s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'serial': '7aa990b6-745f-4c6d-9121-a2720d84e8a4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '15a044ce-baca-4835-bbe9-480ef8795e46', 'serial'} {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:16 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:33:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:16 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:33:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:16 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ca307-ab3b-4eec-ad3c-de5f9039032c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:33:17 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7023ed50-a2e8-4eb6-b745-f4bd4ee7f156]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4] added
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e23527-6603-449a-9bfa-6f1c487db23e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3a0856-e084-4932-a86a-fdfe768e6903]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgTHFibj {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgTHFibj" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b3d48-856f-4d2a-a8dd-7074b26cc7c3]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgTHFibj'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a118e8c-882a-440e-9512-964ea27f648a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e408d4ea-71a1-4868-b96b-ba33ac699ca3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa472b-7e81-47da-a992-c6937b097e2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260]
Nov 03 17:33:17 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260] successful.
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7233f2-2c3b-4418-9764-e76e00c260a7]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4301c3fc-ba4c-412d-be19-081d4d6347c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac2853-8454-4fad-a537-8b6edf1bfa7a]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.volume.cinder [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Update attachment failed for attachment 0d8594a9-221c-438c-b6b7-d0d24fe3ecdd. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Failed to attach bc28a99f-c1dd-4c1b-9ac8-3f5d6e3fedf1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Traceback (most recent call last):
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     connection_info = volume_api.attachment_update(
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     with excutils.save_and_reraise_exception():
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     self.force_reraise()
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     raise self.value
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     return method.func(obj, *args, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     return self.request(url, method, **kwargs)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616]     raise exceptions.from_response(resp, body)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365)
Nov 03 17:33:17 user nova-compute[75463]: ERROR nova.compute.manager [instance: 8068fdfb-ac16-4213-8152-885a91e37616] 
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lazy-loading 'flavor' on Instance uuid 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6e864ac8-9f80-443c-a119-57cb7049d43a tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.156s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.473s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23963646233353330', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963646233353330', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-adc41fea-fa66-48ef-9c4c-71833ab614ae tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f1f67031-ab95-4e4e-84db-e2ca0d6dc365)
Nov 03 17:33:18 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lazy-loading 'flavor' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lazy-loading 'flavor' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-281b3282-7b3c-44ad-b8bf-cd896fe1a5b5 tempest-VolumesAssistedSnapshotsTest-1300548055 tempest-VolumesAssistedSnapshotsTest-1300548055-project-admin] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.198s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:18 user nova-compute[75463]: INFO nova.compute.manager [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Terminating instance
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5e7ef3b9-8e79-4aef-a06f-20af078c238f tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 41.452s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-unplugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] No waiting events found dispatching network-vif-unplugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-1e111d08-f578-4209-b5fe-8a8b7fd865d1 req-4d30ef7d-b32e-479c-b949-6fa8142b49da service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-unplugged-00db5cb6-0806-4249-ad16-50f5d22750b0 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 20971520 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-799c433d-5512-409d-9ea7-1bb7a03d7ad4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-799c433d-5512-409d-9ea7-1bb7a03d7ad4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Instance destroyed successfully.
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lazy-loading 'resources' on Instance uuid 26968122-309b-4eb1-ad6e-bddd5e4639a6 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-459774150',display_name='tempest-AttachSCSIVolumeTestJSON-server-459774150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-459774150',id=7,image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIt4sRxVuMADUMKNN+j5OW1POeeZ+GKf28Py7Ef1gbIHT64i1X/N8ZRiCgUTHoqHExxje6AX+oxErx9j46M+PYZjZSDD9tgRel+BE7/oCzDWigrhm3xFJNOkedmLjKtxw==',key_name='tempest-keypair-1268836043',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acdb43ab35d14b9ca7830846c0588e58',ramdisk_id='',reservation_id='r-ubfwb9vo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f8e175e5-62ac-4cc6-8c0a-09fd099fabf7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1770578812',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1770578812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71d57ec5de304ecdab633cfc23da34d5',uuid=26968122-309b-4eb1-ad6e-bddd5e4639a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converting VIF {"id": "00db5cb6-0806-4249-ad16-50f5d22750b0", "address": "fa:16:3e:af:0c:0d", "network": {"id": "1a360b83-f96e-4a1c-b277-029f22553f77", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1111641814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acdb43ab35d14b9ca7830846c0588e58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00db5cb6-08", "ovs_interfaceid": "00db5cb6-0806-4249-ad16-50f5d22750b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG os_vif [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00db5cb6-08, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4495c3e-c00e-43c0-802b-edb478e3f7a7) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:19 user nova-compute[75463]: INFO os_vif [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:0c:0d,bridge_name='br-int',has_traffic_filtering=True,id=00db5cb6-0806-4249-ad16-50f5d22750b0,network=Network(1a360b83-f96e-4a1c-b277-029f22553f77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00db5cb6-08')
Nov 03 17:33:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Deleting instance files /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6_del
Nov 03 17:33:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Deletion of /opt/stack/data/nova/instances/26968122-309b-4eb1-ad6e-bddd5e4639a6_del complete
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Attempting to detach device tap799c433d-55 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] detach device xml: <interface type="ethernet">
Nov 03 17:33:19 user nova-compute[75463]:   <mac address="fa:16:3e:8d:19:0d"/>
Nov 03 17:33:19 user nova-compute[75463]:   <model type="virtio"/>
Nov 03 17:33:19 user nova-compute[75463]:   <mtu size="1442"/>
Nov 03 17:33:19 user nova-compute[75463]:   <target dev="tap799c433d-55"/>
Nov 03 17:33:19 user nova-compute[75463]: </interface>
Nov 03 17:33:19 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 03 17:33:19 user nova-compute[75463]:   <name>instance-00000006</name>
Nov 03 17:33:19 user nova-compute[75463]:   <uuid>3394c83b-9dc5-44a5-8af9-122da4f80233</uuid>
Nov 03 17:33:19 user nova-compute[75463]:   <metadata>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:19 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:31:19</nova:creationTime>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:19 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:19 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:19 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:19 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:19 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:19 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:19 user nova-compute[75463]:     <nova:port uuid="799c433d-5512-409d-9ea7-1bb7a03d7ad4">
Nov 03 17:33:19 user nova-compute[75463]:       <nova:ip type="fixed" address="10.10.10.114" ipVersion="4"/>
Nov 03 17:33:19 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:19 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:19 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:19 user nova-compute[75463]:   </metadata>
Nov 03 17:33:19 user nova-compute[75463]:   <memory unit='KiB'>524288</memory>
Nov 03 17:33:19 user nova-compute[75463]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 17:33:19 user nova-compute[75463]:   <vcpu placement='static'>1</vcpu>
Nov 03 17:33:19 user nova-compute[75463]:   <resource>
Nov 03 17:33:19 user nova-compute[75463]:     <partition>/machine</partition>
Nov 03 17:33:19 user nova-compute[75463]:   </resource>
Nov 03 17:33:19 user nova-compute[75463]:   <sysinfo type='smbios'>
Nov 03 17:33:19 user nova-compute[75463]:     <system>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='version'>0.0.0</entry>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='serial'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='uuid'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:19 user nova-compute[75463]:       <entry name='family'>Virtual Machine</entry>
Nov 03 17:33:19 user nova-compute[75463]:     </system>
Nov 03 17:33:19 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:19 user nova-compute[75463]:   <os>
Nov 03 17:33:19 user nova-compute[75463]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 17:33:19 user nova-compute[75463]:     <boot dev='hd'/>
Nov 03 17:33:19 user nova-compute[75463]:     <smbios mode='sysinfo'/>
Nov 03 17:33:19 user nova-compute[75463]:   </os>
Nov 03 17:33:19 user nova-compute[75463]:   <features>
Nov 03 17:33:19 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:19 user nova-compute[75463]:     <apic/>
Nov 03 17:33:19 user nova-compute[75463]:     <vmcoreinfo state='on'/>
Nov 03 17:33:19 user nova-compute[75463]:   </features>
Nov 03 17:33:19 user nova-compute[75463]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 17:33:19 user nova-compute[75463]:     <model fallback='forbid'>Nehalem</model>
Nov 03 17:33:19 user nova-compute[75463]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 17:33:19 user nova-compute[75463]:     <feature policy='require' name='vme'/>
Nov 03 17:33:19 user nova-compute[75463]:     <feature policy='require' name='x2apic'/>
Nov 03 17:33:19 user nova-compute[75463]:     <feature policy='require' name='hypervisor'/>
Nov 03 17:33:19 user nova-compute[75463]:   </cpu>
Nov 03 17:33:19 user nova-compute[75463]:   <clock offset='utc'>
Nov 03 17:33:19 user nova-compute[75463]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 17:33:19 user nova-compute[75463]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 17:33:19 user nova-compute[75463]:     <timer name='hpet' present='no'/>
Nov 03 17:33:19 user nova-compute[75463]:   </clock>
Nov 03 17:33:19 user nova-compute[75463]:   <on_poweroff>destroy</on_poweroff>
Nov 03 17:33:19 user nova-compute[75463]:   <on_reboot>restart</on_reboot>
Nov 03 17:33:19 user nova-compute[75463]:   <on_crash>destroy</on_crash>
Nov 03 17:33:19 user nova-compute[75463]:   <devices>
Nov 03 17:33:19 user nova-compute[75463]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 17:33:19 user nova-compute[75463]:     <disk type='file' device='disk'>
Nov 03 17:33:19 user nova-compute[75463]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 17:33:19 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk' index='2'/>
Nov 03 17:33:19 user nova-compute[75463]:       <backingStore type='file' index='3'>
Nov 03 17:33:19 user nova-compute[75463]:         <format type='raw'/>
Nov 03 17:33:19 user nova-compute[75463]:         <source file='/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f'/>
Nov 03 17:33:19 user nova-compute[75463]:         <backingStore/>
Nov 03 17:33:19 user nova-compute[75463]:       </backingStore>
Nov 03 17:33:19 user nova-compute[75463]:       <target dev='vda' bus='virtio'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='virtio-disk0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </disk>
Nov 03 17:33:19 user nova-compute[75463]:     <disk type='file' device='cdrom'>
Nov 03 17:33:19 user nova-compute[75463]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 17:33:19 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config' index='1'/>
Nov 03 17:33:19 user nova-compute[75463]:       <backingStore/>
Nov 03 17:33:19 user nova-compute[75463]:       <target dev='hda' bus='ide'/>
Nov 03 17:33:19 user nova-compute[75463]:       <readonly/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='ide0-0-0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </disk>
Nov 03 17:33:19 user nova-compute[75463]:     <controller type='usb' index='0' model='none'>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='usb'/>
Nov 03 17:33:19 user nova-compute[75463]:     </controller>
Nov 03 17:33:19 user nova-compute[75463]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='pci.0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </controller>
Nov 03 17:33:19 user nova-compute[75463]:     <controller type='ide' index='0'>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='ide'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 17:33:19 user nova-compute[75463]:     </controller>
Nov 03 17:33:19 user nova-compute[75463]:     <interface type='ethernet'>
Nov 03 17:33:19 user nova-compute[75463]:       <mac address='fa:16:3e:d6:09:cb'/>
Nov 03 17:33:19 user nova-compute[75463]:       <target dev='tap7a83cf1d-0d'/>
Nov 03 17:33:19 user nova-compute[75463]:       <model type='virtio'/>
Nov 03 17:33:19 user nova-compute[75463]:       <mtu size='1442'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='net0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </interface>
Nov 03 17:33:19 user nova-compute[75463]:     <interface type='ethernet'>
Nov 03 17:33:19 user nova-compute[75463]:       <mac address='fa:16:3e:8d:19:0d'/>
Nov 03 17:33:19 user nova-compute[75463]:       <target dev='tap799c433d-55'/>
Nov 03 17:33:19 user nova-compute[75463]:       <model type='virtio'/>
Nov 03 17:33:19 user nova-compute[75463]:       <mtu size='1442'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='net1'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </interface>
Nov 03 17:33:19 user nova-compute[75463]:     <serial type='pty'>
Nov 03 17:33:19 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:19 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:19 user nova-compute[75463]:       <target type='isa-serial' port='0'>
Nov 03 17:33:19 user nova-compute[75463]:         <model name='isa-serial'/>
Nov 03 17:33:19 user nova-compute[75463]:       </target>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </serial>
Nov 03 17:33:19 user nova-compute[75463]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 17:33:19 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:19 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:19 user nova-compute[75463]:       <target type='serial' port='0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </console>
Nov 03 17:33:19 user nova-compute[75463]:     <input type='mouse' bus='ps2'>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='input0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </input>
Nov 03 17:33:19 user nova-compute[75463]:     <input type='keyboard' bus='ps2'>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='input1'/>
Nov 03 17:33:19 user nova-compute[75463]:     </input>
Nov 03 17:33:19 user nova-compute[75463]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 03 17:33:19 user nova-compute[75463]:       <listen type='address' address='0.0.0.0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </graphics>
Nov 03 17:33:19 user nova-compute[75463]:     <audio id='1' type='none'/>
Nov 03 17:33:19 user nova-compute[75463]:     <video>
Nov 03 17:33:19 user nova-compute[75463]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='video0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </video>
Nov 03 17:33:19 user nova-compute[75463]:     <memballoon model='virtio'>
Nov 03 17:33:19 user nova-compute[75463]:       <stats period='10'/>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='balloon0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:19 user nova-compute[75463]:     <rng model='virtio'>
Nov 03 17:33:19 user nova-compute[75463]:       <backend model='random'>/dev/urandom</backend>
Nov 03 17:33:19 user nova-compute[75463]:       <alias name='rng0'/>
Nov 03 17:33:19 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 17:33:19 user nova-compute[75463]:     </rng>
Nov 03 17:33:19 user nova-compute[75463]:   </devices>
Nov 03 17:33:19 user nova-compute[75463]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 17:33:19 user nova-compute[75463]:     <label>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</label>
Nov 03 17:33:19 user nova-compute[75463]:     <imagelabel>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</imagelabel>
Nov 03 17:33:19 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:19 user nova-compute[75463]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 17:33:19 user nova-compute[75463]:     <label>+64055:+108</label>
Nov 03 17:33:19 user nova-compute[75463]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 17:33:19 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:19 user nova-compute[75463]: </domain>
Nov 03 17:33:19 user nova-compute[75463]:  {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 17:33:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully detached device tap799c433d-55 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the persistent domain config.
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] (1/8): Attempting to detach device tap799c433d-55 with device alias net1 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] detach device xml: <interface type="ethernet">
Nov 03 17:33:19 user nova-compute[75463]:   <mac address="fa:16:3e:8d:19:0d"/>
Nov 03 17:33:19 user nova-compute[75463]:   <model type="virtio"/>
Nov 03 17:33:19 user nova-compute[75463]:   <mtu size="1442"/>
Nov 03 17:33:19 user nova-compute[75463]:   <target dev="tap799c433d-55"/>
Nov 03 17:33:19 user nova-compute[75463]: </interface>
Nov 03 17:33:19 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:33:19 user nova-compute[75463]: INFO nova.compute.manager [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 03 17:33:19 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:33:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 38797312 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Start waiting for the detach event from libvirt for device tap799c433d-55 with device alias net1 for instance 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 76546048 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Acquiring lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] No waiting events found dispatching network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:21 user nova-compute[75463]: WARNING nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received unexpected event network-vif-plugged-00db5cb6-0806-4249-ad16-50f5d22750b0 for instance with vm_state active and task_state deleting.
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-unplugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-unplugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:21 user nova-compute[75463]: WARNING nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-unplugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 for instance with vm_state active and task_state None.
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:21 user nova-compute[75463]: WARNING nova.compute.manager [req-c0167b02-154c-4b65-9745-0054cf5bd27a req-41d77dab-f7fd-4ca6-95fd-d12db63047c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-799c433d-5512-409d-9ea7-1bb7a03d7ad4 for instance with vm_state active and task_state None.
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-1e6a742b-f732-4ad4-81ac-1a084747e87c req-86a25c80-0373-4df4-ad36-26d62f58322f service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Received event network-vif-deleted-00db5cb6-0806-4249-ad16-50f5d22750b0 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:21 user nova-compute[75463]: INFO nova.compute.manager [req-1e6a742b-f732-4ad4-81ac-1a084747e87c req-86a25c80-0373-4df4-ad36-26d62f58322f service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Neutron deleted interface 00db5cb6-0806-4249-ad16-50f5d22750b0; detaching it from the instance and deleting it from the info cache
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.network.neutron [req-1e6a742b-f732-4ad4-81ac-1a084747e87c req-86a25c80-0373-4df4-ad36-26d62f58322f service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:21 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Took 1.45 seconds to deallocate network for instance.
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-1e6a742b-f732-4ad4-81ac-1a084747e87c req-86a25c80-0373-4df4-ad36-26d62f58322f service nova] [instance: 26968122-309b-4eb1-ad6e-bddd5e4639a6] Detach interface failed, port_id=00db5cb6-0806-4249-ad16-50f5d22750b0, reason: Instance 26968122-309b-4eb1-ad6e-bddd5e4639a6 could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 187695104 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 248512512 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:22 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Deleted allocations for instance 26968122-309b-4eb1-ad6e-bddd5e4639a6
Nov 03 17:33:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2f4a606b-97d5-48ef-af53-522472e53e4c tempest-AttachSCSIVolumeTestJSON-1770578812 tempest-AttachSCSIVolumeTestJSON-1770578812-project-member] Lock "26968122-309b-4eb1-ad6e-bddd5e4639a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.411s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 340787200 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 567279616 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 840957952 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 877658112 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 996147200 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c7597-796c-4c8d-b17d-88096af92784]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:33:26 user nova-compute[75463]: No targets found.
Nov 03 17:33:26 user nova-compute[75463]: iSNS:
Nov 03 17:33:26 user nova-compute[75463]: No targets found.
Nov 03 17:33:26 user nova-compute[75463]: STATIC:
Nov 03 17:33:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:33:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:33:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:33:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:33:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:33:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:33:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:33:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:33:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:33:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4
Nov 03 17:33:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:33:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:33:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:33:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:33:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:33:26 user nova-compute[75463]: FIRMWARE:
Nov 03 17:33:26 user nova-compute[75463]: No targets found.
Nov 03 17:33:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:33:26 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:33:26 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac req-a62b15f7-f684-44f5-9a2e-927a6e78e6d2 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event volume-reimaged-5f8552c3-a6cd-4a56-8643-c73eef62e850 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac req-a62b15f7-f684-44f5-9a2e-927a6e78e6d2 service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac req-a62b15f7-f684-44f5-9a2e-927a6e78e6d2 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac req-a62b15f7-f684-44f5-9a2e-927a6e78e6d2 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac req-a62b15f7-f684-44f5-9a2e-927a6e78e6d2 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Processing event volume-reimaged-5f8552c3-a6cd-4a56-8643-c73eef62e850 {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance event wait completed in 45 seconds for volume-reimaged {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa933939-468f-46a3-b65c-47e4c8c8b31a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5611b9-2163-4113-b1a6-cda5414ddc7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec465cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46'): ({'sdi'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Removing single pathed devices sdi {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3254475-702a-48e9-9f4e-50ff0dd708bd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: INFO nova.virt.block_device [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Booting with volume 5f8552c3-a6cd-4a56-8643-c73eef62e850 at /dev/vda
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c53c32-3e4f-4209-88a8-d119df24e6af]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Flushing IO for device /dev/sdi {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b40a8d-078f-4524-9efa-fb5c43aa9d98]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.utils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d79ea7-4a9e-4279-949d-ca73e8cb1635]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] SCSI volumes sdi have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcaf38f-391e-41eb-93fa-24af16e0cef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e319751-125f-49ad-81fa-17b74addc48d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca6f9e-f6a1-4e1c-95fb-d63c8fdeda13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0da2e-63dc-4515-8433-61fd796a3ea1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a030798a-a553-4ae3-a805-d63f9e22e9b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[79425a47-6e8a-45d0-845d-28a65ae02aa6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]
Nov 03 17:33:26 user nova-compute[75463]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.
Nov 03 17:33:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:33:26 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069d4cb-7794-4585-aa0c-949eb8618489]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.utils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating existing volume attachment record: e9fa3486-4cec-4b9d-acad-476819e5f8dd {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c232e25-322d-4ce6-a3e1-e6cbaf0147e3]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== disconnect_volume: return (351ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:33:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:33:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'serial'} {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 03 17:33:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: removing Cinder connection for volume 15a044ce-baca-4835-bbe9-480ef8795e46 {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: Updating volume 15a044ce-baca-4835-bbe9-480ef8795e46 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IgTHFibj", "auth_password": "EoTH4JxfpIU6t7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "7aa990b6-745f-4c6d-9121-a2720d84e8a4"}, "status": "reserved", "instance": "aa42692c-c217-41b8-a584-c9b33686c643", "attached_at": "", "detached_at": "", "volume_id": "7aa990b6-745f-4c6d-9121-a2720d84e8a4", "serial": "7aa990b6-745f-4c6d-9121-a2720d84e8a4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'no_device': None, 'attachment_id': '88812e9d-4a5b-4d51-b568-edd582b016e6'} {{(pid=75463) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-15dad97c-0e56-435e-9fc1-f1ff08ed247d tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.029s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:33:28 user nova-compute[75463]: INFO nova.compute.claims [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Claim successful on node user
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG os_brick.utils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[413184c2-b0b3-4cf7-94cd-7185f3d52c78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[069925ed-1342-4771-9580-419561de1028]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4da38c-335e-436f-9892-84b1b1c7e21b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1565f1-86da-4ee3-a3f0-7e1850922340]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:33:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:33:29 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[64269a3d-fb7d-44c1-8e0b-d627e04eade2]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG os_brick.utils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:33:29 user nova-compute[75463]: INFO nova.compute.manager [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Swapping volume 7aa990b6-745f-4c6d-9121-a2720d84e8a4 for 15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:33:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.policy [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2991422c844b4064bb476827300e4119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51f4c5d074ef4609b31b26e88ed3bf1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:33:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Creating image(s)
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "/opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "/opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "/opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.264s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk 1073741824" returned: 0 in 0.069s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Successfully created port: a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.278s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Cannot resize image /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Ensure instance console log exists: /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Successfully updated port: a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquired lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-changed-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Refreshing instance network info cache due to event network-changed-a62c39e7-6f7e-4c55-9ce2-19ca352296f5. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] Acquiring lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Updating instance_info_cache with network_info: [{"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Releasing lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Instance network_info: |[{"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] Acquired lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.network.neutron [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Refreshing network info cache for port a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Start _get_guest_xml network_info=[{"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:33:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:33:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1618144656',display_name='tempest-VolumesAdminNegativeTest-server-1618144656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1618144656',id=15,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-lfzfj7xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:33:29Z,user_data=None,user_id='2991422c844b4064bb476827300e4119',uuid=7158723b-e605-4046-8352-d0cf7ee1e9ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'pci_devices' on Instance uuid 7158723b-e605-4046-8352-d0cf7ee1e9ab {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:33:32 user nova-compute[75463]:   <uuid>7158723b-e605-4046-8352-d0cf7ee1e9ab</uuid>
Nov 03 17:33:32 user nova-compute[75463]:   <name>instance-0000000f</name>
Nov 03 17:33:32 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:33:32 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:33:32 user nova-compute[75463]:   <metadata>
Nov 03 17:33:32 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:32 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1618144656</nova:name>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:33:31</nova:creationTime>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:33:32 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:32 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:owner>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:user uuid="2991422c844b4064bb476827300e4119">tempest-VolumesAdminNegativeTest-1183184812-project-member</nova:user>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:project uuid="51f4c5d074ef4609b31b26e88ed3bf1f">tempest-VolumesAdminNegativeTest-1183184812</nova:project>
Nov 03 17:33:32 user nova-compute[75463]:       </nova:owner>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:32 user nova-compute[75463]:       <nova:ports>
Nov 03 17:33:32 user nova-compute[75463]:         <nova:port uuid="a62c39e7-6f7e-4c55-9ce2-19ca352296f5">
Nov 03 17:33:32 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 17:33:32 user nova-compute[75463]:         </nova:port>
Nov 03 17:33:32 user nova-compute[75463]:       </nova:ports>
Nov 03 17:33:32 user nova-compute[75463]:     </nova:instance>
Nov 03 17:33:32 user nova-compute[75463]:   </metadata>
Nov 03 17:33:32 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:33:32 user nova-compute[75463]:     <system>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="serial">7158723b-e605-4046-8352-d0cf7ee1e9ab</entry>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="uuid">7158723b-e605-4046-8352-d0cf7ee1e9ab</entry>
Nov 03 17:33:32 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:33:32 user nova-compute[75463]:     </system>
Nov 03 17:33:32 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:32 user nova-compute[75463]:   <os>
Nov 03 17:33:32 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:33:32 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:33:32 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:33:32 user nova-compute[75463]:   </os>
Nov 03 17:33:32 user nova-compute[75463]:   <features>
Nov 03 17:33:32 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:32 user nova-compute[75463]:     <apic/>
Nov 03 17:33:32 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:33:32 user nova-compute[75463]:   </features>
Nov 03 17:33:32 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:33:32 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:33:32 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:33:32 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:33:32 user nova-compute[75463]:   </clock>
Nov 03 17:33:32 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:33:32 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:33:32 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:33:32 user nova-compute[75463]:   </cpu>
Nov 03 17:33:32 user nova-compute[75463]:   <devices>
Nov 03 17:33:32 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:33:32 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:33:32 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk"/>
Nov 03 17:33:32 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:33:32 user nova-compute[75463]:     </disk>
Nov 03 17:33:32 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:33:32 user nova-compute[75463]:       <mac address="fa:16:3e:a0:85:68"/>
Nov 03 17:33:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:33:32 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:33:32 user nova-compute[75463]:       <target dev="tapa62c39e7-6f"/>
Nov 03 17:33:32 user nova-compute[75463]:     </interface>
Nov 03 17:33:32 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:33:32 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/console.log" append="off"/>
Nov 03 17:33:32 user nova-compute[75463]:     </serial>
Nov 03 17:33:32 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:33:32 user nova-compute[75463]:     <video>
Nov 03 17:33:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:33:32 user nova-compute[75463]:     </video>
Nov 03 17:33:32 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:33:32 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:33:32 user nova-compute[75463]:     </rng>
Nov 03 17:33:32 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:33:32 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:33:32 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:33:32 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:32 user nova-compute[75463]:   </devices>
Nov 03 17:33:32 user nova-compute[75463]: </domain>
Nov 03 17:33:32 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1618144656',display_name='tempest-VolumesAdminNegativeTest-server-1618144656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1618144656',id=15,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-lfzfj7xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:33:29Z,user_data=None,user_id='2991422c844b4064bb476827300e4119',uuid=7158723b-e605-4046-8352-d0cf7ee1e9ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG os_vif [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c7e3a4d-a2dd-57a1-8213-04ccc6293a7e', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa62c39e7-6f, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa62c39e7-6f, col_values=(('qos', UUID('cda9b1eb-32ff-4302-8c7c-5e6577cbd7c7')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa62c39e7-6f, col_values=(('external_ids', {'iface-id': 'a62c39e7-6f7e-4c55-9ce2-19ca352296f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:85:68', 'vm-uuid': '7158723b-e605-4046-8352-d0cf7ee1e9ab'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: INFO os_vif [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f')
Nov 03 17:33:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] No VIF found with MAC fa:16:3e:a0:85:68, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.neutron [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Updated VIF entry in instance network info cache for port a62c39e7-6f7e-4c55-9ce2-19ca352296f5. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG nova.network.neutron [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Updating instance_info_cache with network_info: [{"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a05ee645-18c1-4da5-8e6f-ac5bc986aef3 req-75cdbf8b-0f59-44ee-bca9-151e06f98706 service nova] Releasing lock "refresh_cache-7158723b-e605-4046-8352-d0cf7ee1e9ab" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] No waiting events found dispatching network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:33 user nova-compute[75463]: WARNING nova.compute.manager [req-f0859faf-7815-4945-b208-00b3977090f8 req-bb9cc231-51d3-41a6-bcaf-0f5e8e3f06ec service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received unexpected event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 for instance with vm_state building and task_state spawning.
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] No waiting events found dispatching network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:36 user nova-compute[75463]: WARNING nova.compute.manager [req-9b1e1a65-903e-42d2-bb9a-f43c0fe0c0af req-43a8704d-3563-4d0f-9122-817e9bead0b1 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received unexpected event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 for instance with vm_state building and task_state spawning.
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:33:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Instance spawned successfully.
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:33:36 user nova-compute[75463]: INFO nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 03 17:33:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:33:36 user nova-compute[75463]: INFO nova.compute.manager [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Took 7.95 seconds to build instance.
Nov 03 17:33:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2c8c3c94-2b48-4165-94a6-12b7c1f8389e tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.109s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:40 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Waiting for libvirt event about the detach of device tap799c433d-55 with device alias net1 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 is timed out.
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 03 17:33:40 user nova-compute[75463]:   <name>instance-00000006</name>
Nov 03 17:33:40 user nova-compute[75463]:   <uuid>3394c83b-9dc5-44a5-8af9-122da4f80233</uuid>
Nov 03 17:33:40 user nova-compute[75463]:   <metadata>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:40 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:31:19</nova:creationTime>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:40 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="799c433d-5512-409d-9ea7-1bb7a03d7ad4">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.10.10.114" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:40 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:40 user nova-compute[75463]:   </metadata>
Nov 03 17:33:40 user nova-compute[75463]:   <memory unit='KiB'>524288</memory>
Nov 03 17:33:40 user nova-compute[75463]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 17:33:40 user nova-compute[75463]:   <vcpu placement='static'>1</vcpu>
Nov 03 17:33:40 user nova-compute[75463]:   <resource>
Nov 03 17:33:40 user nova-compute[75463]:     <partition>/machine</partition>
Nov 03 17:33:40 user nova-compute[75463]:   </resource>
Nov 03 17:33:40 user nova-compute[75463]:   <sysinfo type='smbios'>
Nov 03 17:33:40 user nova-compute[75463]:     <system>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='version'>0.0.0</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='serial'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='uuid'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='family'>Virtual Machine</entry>
Nov 03 17:33:40 user nova-compute[75463]:     </system>
Nov 03 17:33:40 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:40 user nova-compute[75463]:   <os>
Nov 03 17:33:40 user nova-compute[75463]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 17:33:40 user nova-compute[75463]:     <boot dev='hd'/>
Nov 03 17:33:40 user nova-compute[75463]:     <smbios mode='sysinfo'/>
Nov 03 17:33:40 user nova-compute[75463]:   </os>
Nov 03 17:33:40 user nova-compute[75463]:   <features>
Nov 03 17:33:40 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:40 user nova-compute[75463]:     <apic/>
Nov 03 17:33:40 user nova-compute[75463]:     <vmcoreinfo state='on'/>
Nov 03 17:33:40 user nova-compute[75463]:   </features>
Nov 03 17:33:40 user nova-compute[75463]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 17:33:40 user nova-compute[75463]:     <model fallback='forbid'>Nehalem</model>
Nov 03 17:33:40 user nova-compute[75463]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='vme'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='x2apic'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='hypervisor'/>
Nov 03 17:33:40 user nova-compute[75463]:   </cpu>
Nov 03 17:33:40 user nova-compute[75463]:   <clock offset='utc'>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='hpet' present='no'/>
Nov 03 17:33:40 user nova-compute[75463]:   </clock>
Nov 03 17:33:40 user nova-compute[75463]:   <on_poweroff>destroy</on_poweroff>
Nov 03 17:33:40 user nova-compute[75463]:   <on_reboot>restart</on_reboot>
Nov 03 17:33:40 user nova-compute[75463]:   <on_crash>destroy</on_crash>
Nov 03 17:33:40 user nova-compute[75463]:   <devices>
Nov 03 17:33:40 user nova-compute[75463]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='disk'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk' index='2'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore type='file' index='3'>
Nov 03 17:33:40 user nova-compute[75463]:         <format type='raw'/>
Nov 03 17:33:40 user nova-compute[75463]:         <source file='/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f'/>
Nov 03 17:33:40 user nova-compute[75463]:         <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       </backingStore>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='vda' bus='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='virtio-disk0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='cdrom'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config' index='1'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='hda' bus='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <readonly/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide0-0-0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='usb' index='0' model='none'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='usb'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='pci.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='ide' index='0'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <interface type='ethernet'>
Nov 03 17:33:40 user nova-compute[75463]:       <mac address='fa:16:3e:d6:09:cb'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='tap7a83cf1d-0d'/>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <mtu size='1442'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='net0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </interface>
Nov 03 17:33:40 user nova-compute[75463]:     <serial type='pty'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='isa-serial' port='0'>
Nov 03 17:33:40 user nova-compute[75463]:         <model name='isa-serial'/>
Nov 03 17:33:40 user nova-compute[75463]:       </target>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </serial>
Nov 03 17:33:40 user nova-compute[75463]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='serial' port='0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </console>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='mouse' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='keyboard' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 03 17:33:40 user nova-compute[75463]:       <listen type='address' address='0.0.0.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </graphics>
Nov 03 17:33:40 user nova-compute[75463]:     <audio id='1' type='none'/>
Nov 03 17:33:40 user nova-compute[75463]:     <video>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='video0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </video>
Nov 03 17:33:40 user nova-compute[75463]:     <memballoon model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <stats period='10'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='balloon0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:40 user nova-compute[75463]:     <rng model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <backend model='random'>/dev/urandom</backend>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='rng0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </rng>
Nov 03 17:33:40 user nova-compute[75463]:   </devices>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>+64055:+108</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]: </domain>
Nov 03 17:33:40 user nova-compute[75463]:  {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 17:33:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully detached device tap799c433d-55 from instance 3394c83b-9dc5-44a5-8af9-122da4f80233 from the live domain config.
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG os_vif [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap799c433d-55, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57190280-3a2f-4881-9792-00a7b6625d59) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:40 user nova-compute[75463]: INFO os_vif [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55')
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:40 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:33:40</nova:creationTime>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:40 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:40 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:40 user nova-compute[75463]:  {{(pid=75463) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.compute.manager [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-deleted-799c433d-5512-409d-9ea7-1bb7a03d7ad4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:40 user nova-compute[75463]: INFO nova.compute.manager [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Neutron deleted interface 799c433d-5512-409d-9ea7-1bb7a03d7ad4; detaching it from the instance and deleting it from the info cache
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.neutron [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquired lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.objects.instance [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Lazy-loading 'system_metadata' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.objects.instance [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Lazy-loading 'flavor' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.objects.base [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Object Instance<3394c83b-9dc5-44a5-8af9-122da4f80233> lazy-loaded attributes: system_metadata,flavor {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 03 17:33:40 user nova-compute[75463]:   <name>instance-00000006</name>
Nov 03 17:33:40 user nova-compute[75463]:   <uuid>3394c83b-9dc5-44a5-8af9-122da4f80233</uuid>
Nov 03 17:33:40 user nova-compute[75463]:   <metadata>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:40 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:33:40</nova:creationTime>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:40 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:40 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:40 user nova-compute[75463]:   </metadata>
Nov 03 17:33:40 user nova-compute[75463]:   <memory unit='KiB'>524288</memory>
Nov 03 17:33:40 user nova-compute[75463]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 17:33:40 user nova-compute[75463]:   <vcpu placement='static'>1</vcpu>
Nov 03 17:33:40 user nova-compute[75463]:   <resource>
Nov 03 17:33:40 user nova-compute[75463]:     <partition>/machine</partition>
Nov 03 17:33:40 user nova-compute[75463]:   </resource>
Nov 03 17:33:40 user nova-compute[75463]:   <sysinfo type='smbios'>
Nov 03 17:33:40 user nova-compute[75463]:     <system>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='version'>0.0.0</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='serial'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='uuid'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='family'>Virtual Machine</entry>
Nov 03 17:33:40 user nova-compute[75463]:     </system>
Nov 03 17:33:40 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:40 user nova-compute[75463]:   <os>
Nov 03 17:33:40 user nova-compute[75463]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 17:33:40 user nova-compute[75463]:     <boot dev='hd'/>
Nov 03 17:33:40 user nova-compute[75463]:     <smbios mode='sysinfo'/>
Nov 03 17:33:40 user nova-compute[75463]:   </os>
Nov 03 17:33:40 user nova-compute[75463]:   <features>
Nov 03 17:33:40 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:40 user nova-compute[75463]:     <apic/>
Nov 03 17:33:40 user nova-compute[75463]:     <vmcoreinfo state='on'/>
Nov 03 17:33:40 user nova-compute[75463]:   </features>
Nov 03 17:33:40 user nova-compute[75463]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 17:33:40 user nova-compute[75463]:     <model fallback='forbid'>Nehalem</model>
Nov 03 17:33:40 user nova-compute[75463]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='vme'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='x2apic'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='hypervisor'/>
Nov 03 17:33:40 user nova-compute[75463]:   </cpu>
Nov 03 17:33:40 user nova-compute[75463]:   <clock offset='utc'>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='hpet' present='no'/>
Nov 03 17:33:40 user nova-compute[75463]:   </clock>
Nov 03 17:33:40 user nova-compute[75463]:   <on_poweroff>destroy</on_poweroff>
Nov 03 17:33:40 user nova-compute[75463]:   <on_reboot>restart</on_reboot>
Nov 03 17:33:40 user nova-compute[75463]:   <on_crash>destroy</on_crash>
Nov 03 17:33:40 user nova-compute[75463]:   <devices>
Nov 03 17:33:40 user nova-compute[75463]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='disk'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk' index='2'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore type='file' index='3'>
Nov 03 17:33:40 user nova-compute[75463]:         <format type='raw'/>
Nov 03 17:33:40 user nova-compute[75463]:         <source file='/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f'/>
Nov 03 17:33:40 user nova-compute[75463]:         <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       </backingStore>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='vda' bus='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='virtio-disk0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='cdrom'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config' index='1'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='hda' bus='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <readonly/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide0-0-0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='usb' index='0' model='none'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='usb'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='pci.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='ide' index='0'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <interface type='ethernet'>
Nov 03 17:33:40 user nova-compute[75463]:       <mac address='fa:16:3e:d6:09:cb'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='tap7a83cf1d-0d'/>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <mtu size='1442'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='net0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </interface>
Nov 03 17:33:40 user nova-compute[75463]:     <serial type='pty'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='isa-serial' port='0'>
Nov 03 17:33:40 user nova-compute[75463]:         <model name='isa-serial'/>
Nov 03 17:33:40 user nova-compute[75463]:       </target>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </serial>
Nov 03 17:33:40 user nova-compute[75463]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='serial' port='0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </console>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='mouse' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='keyboard' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 03 17:33:40 user nova-compute[75463]:       <listen type='address' address='0.0.0.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </graphics>
Nov 03 17:33:40 user nova-compute[75463]:     <audio id='1' type='none'/>
Nov 03 17:33:40 user nova-compute[75463]:     <video>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='video0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </video>
Nov 03 17:33:40 user nova-compute[75463]:     <memballoon model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <stats period='10'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='balloon0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:40 user nova-compute[75463]:     <rng model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <backend model='random'>/dev/urandom</backend>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='rng0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </rng>
Nov 03 17:33:40 user nova-compute[75463]:   </devices>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>+64055:+108</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]: </domain>
Nov 03 17:33:40 user nova-compute[75463]:  {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface> {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8d:19:0d"/><model type="virtio"/><mtu size="1442"/><target dev="tap799c433d-55"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 03 17:33:40 user nova-compute[75463]:   <name>instance-00000006</name>
Nov 03 17:33:40 user nova-compute[75463]:   <uuid>3394c83b-9dc5-44a5-8af9-122da4f80233</uuid>
Nov 03 17:33:40 user nova-compute[75463]:   <metadata>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:40 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:33:40</nova:creationTime>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:40 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:40 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:40 user nova-compute[75463]:   </metadata>
Nov 03 17:33:40 user nova-compute[75463]:   <memory unit='KiB'>524288</memory>
Nov 03 17:33:40 user nova-compute[75463]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 03 17:33:40 user nova-compute[75463]:   <vcpu placement='static'>1</vcpu>
Nov 03 17:33:40 user nova-compute[75463]:   <resource>
Nov 03 17:33:40 user nova-compute[75463]:     <partition>/machine</partition>
Nov 03 17:33:40 user nova-compute[75463]:   </resource>
Nov 03 17:33:40 user nova-compute[75463]:   <sysinfo type='smbios'>
Nov 03 17:33:40 user nova-compute[75463]:     <system>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='product'>OpenStack Nova</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='version'>0.0.0</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='serial'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='uuid'>3394c83b-9dc5-44a5-8af9-122da4f80233</entry>
Nov 03 17:33:40 user nova-compute[75463]:       <entry name='family'>Virtual Machine</entry>
Nov 03 17:33:40 user nova-compute[75463]:     </system>
Nov 03 17:33:40 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:40 user nova-compute[75463]:   <os>
Nov 03 17:33:40 user nova-compute[75463]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 03 17:33:40 user nova-compute[75463]:     <boot dev='hd'/>
Nov 03 17:33:40 user nova-compute[75463]:     <smbios mode='sysinfo'/>
Nov 03 17:33:40 user nova-compute[75463]:   </os>
Nov 03 17:33:40 user nova-compute[75463]:   <features>
Nov 03 17:33:40 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:40 user nova-compute[75463]:     <apic/>
Nov 03 17:33:40 user nova-compute[75463]:     <vmcoreinfo state='on'/>
Nov 03 17:33:40 user nova-compute[75463]:   </features>
Nov 03 17:33:40 user nova-compute[75463]:   <cpu mode='custom' match='exact' check='full'>
Nov 03 17:33:40 user nova-compute[75463]:     <model fallback='forbid'>Nehalem</model>
Nov 03 17:33:40 user nova-compute[75463]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='vme'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='x2apic'/>
Nov 03 17:33:40 user nova-compute[75463]:     <feature policy='require' name='hypervisor'/>
Nov 03 17:33:40 user nova-compute[75463]:   </cpu>
Nov 03 17:33:40 user nova-compute[75463]:   <clock offset='utc'>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='pit' tickpolicy='delay'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 03 17:33:40 user nova-compute[75463]:     <timer name='hpet' present='no'/>
Nov 03 17:33:40 user nova-compute[75463]:   </clock>
Nov 03 17:33:40 user nova-compute[75463]:   <on_poweroff>destroy</on_poweroff>
Nov 03 17:33:40 user nova-compute[75463]:   <on_reboot>restart</on_reboot>
Nov 03 17:33:40 user nova-compute[75463]:   <on_crash>destroy</on_crash>
Nov 03 17:33:40 user nova-compute[75463]:   <devices>
Nov 03 17:33:40 user nova-compute[75463]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='disk'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk' index='2'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore type='file' index='3'>
Nov 03 17:33:40 user nova-compute[75463]:         <format type='raw'/>
Nov 03 17:33:40 user nova-compute[75463]:         <source file='/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f'/>
Nov 03 17:33:40 user nova-compute[75463]:         <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       </backingStore>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='vda' bus='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='virtio-disk0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <disk type='file' device='cdrom'>
Nov 03 17:33:40 user nova-compute[75463]:       <driver name='qemu' type='raw' cache='none'/>
Nov 03 17:33:40 user nova-compute[75463]:       <source file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk.config' index='1'/>
Nov 03 17:33:40 user nova-compute[75463]:       <backingStore/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='hda' bus='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <readonly/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide0-0-0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </disk>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='usb' index='0' model='none'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='usb'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='pci' index='0' model='pci-root'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='pci.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <controller type='ide' index='0'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='ide'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </controller>
Nov 03 17:33:40 user nova-compute[75463]:     <interface type='ethernet'>
Nov 03 17:33:40 user nova-compute[75463]:       <mac address='fa:16:3e:d6:09:cb'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target dev='tap7a83cf1d-0d'/>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio'/>
Nov 03 17:33:40 user nova-compute[75463]:       <mtu size='1442'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='net0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </interface>
Nov 03 17:33:40 user nova-compute[75463]:     <serial type='pty'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='isa-serial' port='0'>
Nov 03 17:33:40 user nova-compute[75463]:         <model name='isa-serial'/>
Nov 03 17:33:40 user nova-compute[75463]:       </target>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </serial>
Nov 03 17:33:40 user nova-compute[75463]:     <console type='pty' tty='/dev/pts/6'>
Nov 03 17:33:40 user nova-compute[75463]:       <source path='/dev/pts/6'/>
Nov 03 17:33:40 user nova-compute[75463]:       <log file='/opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/console.log' append='off'/>
Nov 03 17:33:40 user nova-compute[75463]:       <target type='serial' port='0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='serial0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </console>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='mouse' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <input type='keyboard' bus='ps2'>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='input1'/>
Nov 03 17:33:40 user nova-compute[75463]:     </input>
Nov 03 17:33:40 user nova-compute[75463]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 03 17:33:40 user nova-compute[75463]:       <listen type='address' address='0.0.0.0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </graphics>
Nov 03 17:33:40 user nova-compute[75463]:     <audio id='1' type='none'/>
Nov 03 17:33:40 user nova-compute[75463]:     <video>
Nov 03 17:33:40 user nova-compute[75463]:       <model type='virtio' heads='1' primary='yes'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='video0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </video>
Nov 03 17:33:40 user nova-compute[75463]:     <memballoon model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <stats period='10'/>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='balloon0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:40 user nova-compute[75463]:     <rng model='virtio'>
Nov 03 17:33:40 user nova-compute[75463]:       <backend model='random'>/dev/urandom</backend>
Nov 03 17:33:40 user nova-compute[75463]:       <alias name='rng0'/>
Nov 03 17:33:40 user nova-compute[75463]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 03 17:33:40 user nova-compute[75463]:     </rng>
Nov 03 17:33:40 user nova-compute[75463]:   </devices>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>libvirt-3394c83b-9dc5-44a5-8af9-122da4f80233</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 03 17:33:40 user nova-compute[75463]:     <label>+64055:+108</label>
Nov 03 17:33:40 user nova-compute[75463]:     <imagelabel>+64055:+108</imagelabel>
Nov 03 17:33:40 user nova-compute[75463]:   </seclabel>
Nov 03 17:33:40 user nova-compute[75463]: </domain>
Nov 03 17:33:40 user nova-compute[75463]:  {{(pid=75463) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 03 17:33:40 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Detaching interface fa:16:3e:8d:19:0d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap799c433d-55' not found.
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Converting VIF {"id": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "address": "fa:16:3e:8d:19:0d", "network": {"id": "b1aa8ffb-c479-4a3e-93b5-49e2ea81983f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-210548685", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c433d-55", "ovs_interfaceid": "799c433d-5512-409d-9ea7-1bb7a03d7ad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG os_vif [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap799c433d-55, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:33:40 user nova-compute[75463]: INFO os_vif [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=799c433d-5512-409d-9ea7-1bb7a03d7ad4,network=Network(b1aa8ffb-c479-4a3e-93b5-49e2ea81983f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c433d-55')
Nov 03 17:33:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [req-889f238f-a19a-4eed-947f-7353734a8647 req-edfc198f-78f6-4203-8351-c568bbc50d6f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:40 user nova-compute[75463]:   <nova:package version="0.0.0"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:name>tempest-device-tagging-server-1583190705</nova:name>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:creationTime>2023-11-03 17:33:40</nova:creationTime>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:flavor name="m1.tiny">
Nov 03 17:33:40 user nova-compute[75463]:     <nova:memory>512</nova:memory>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:disk>1</nova:disk>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:swap>0</nova:swap>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:flavor>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:user uuid="7015a1cbbd024518b9590d2561dc02db">tempest-TaggedAttachmentsTest-901062206-project-member</nova:user>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:project uuid="b2f7989faf6b4c08b25287cd6fb74ab4">tempest-TaggedAttachmentsTest-901062206</nova:project>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:owner>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:40 user nova-compute[75463]:   <nova:ports>
Nov 03 17:33:40 user nova-compute[75463]:     <nova:port uuid="7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1">
Nov 03 17:33:40 user nova-compute[75463]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:33:40 user nova-compute[75463]:     </nova:port>
Nov 03 17:33:40 user nova-compute[75463]:   </nova:ports>
Nov 03 17:33:40 user nova-compute[75463]: </nova:instance>
Nov 03 17:33:40 user nova-compute[75463]:  {{(pid=75463) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:41 user nova-compute[75463]: INFO nova.compute.manager [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Terminating instance
Nov 03 17:33:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [{"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Releasing lock "refresh_cache-3394c83b-9dc5-44a5-8af9-122da4f80233" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6ed35ea2-cd12-40cb-b71f-7fec29c8bb0c tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "interface-3394c83b-9dc5-44a5-8af9-122da4f80233-799c433d-5512-409d-9ea7-1bb7a03d7ad4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.904s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-unplugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] No waiting events found dispatching network-vif-unplugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-6a57b48d-455d-4403-961b-e24c65335b52 req-4031b2fe-5390-4bee-84ae-95b6de5de271 service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-unplugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:33:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Instance destroyed successfully.
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lazy-loading 'resources' on Instance uuid affef3a2-57dd-421c-aaeb-7b2030a51246 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-401777592',display_name='tempest-VolumesAssistedSnapshotsTest-server-401777592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-401777592',id=9,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/MUJAQgex8k2TGLfkb8lCSCpfr3dAspub02DijAn+Ukb+kuXyQxNPKOdZocjfowi6v3xQZUfNCB7mRqSuSeAboLE3zsQYEWCKBnLqWPRbZaMbMOGpvJKMCUkhrF23fOQ==',key_name='tempest-keypair-1854853604',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6f94a3551fe419dad5248f0b32da45c',ramdisk_id='',reservation_id='r-3hk9dtn6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-440291304',owner_user_name='tempest-VolumesAssistedSnapshotsTest-440291304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda029c294624e9689870edc4385c829',uuid=affef3a2-57dd-421c-aaeb-7b2030a51246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converting VIF {"id": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "address": "fa:16:3e:8b:1c:e8", "network": {"id": "f9acf688-3e55-4814-916f-cb6cfbabb776", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460216410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6f94a3551fe419dad5248f0b32da45c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2801d863-dc", "ovs_interfaceid": "2801d863-dcfc-4a6a-bc26-1bd5b1575685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG os_vif [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2801d863-dc, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2441ea2f-561a-4079-9cdc-16b2cef0fb87) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:42 user nova-compute[75463]: INFO os_vif [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:1c:e8,bridge_name='br-int',has_traffic_filtering=True,id=2801d863-dcfc-4a6a-bc26-1bd5b1575685,network=Network(f9acf688-3e55-4814-916f-cb6cfbabb776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2801d863-dc')
Nov 03 17:33:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Deleting instance files /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246_del
Nov 03 17:33:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Deletion of /opt/stack/data/nova/instances/affef3a2-57dd-421c-aaeb-7b2030a51246_del complete
Nov 03 17:33:42 user nova-compute[75463]: INFO nova.compute.manager [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 03 17:33:42 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:33:42 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:43 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Took 0.96 seconds to deallocate network for instance.
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-199e6d8f-1d82-483e-b211-78e36266872a req-ea1da0bf-f353-4519-bc86-95f78851693e service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-deleted-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:43 user nova-compute[75463]: INFO nova.compute.manager [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Rescuing
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] Acquiring lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] No waiting events found dispatching network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:43 user nova-compute[75463]: WARNING nova.compute.manager [req-718c385f-172f-43ea-81b3-0b8700a0933b req-441d3797-1391-4c03-bedd-7bee5d404dfc service nova] [instance: affef3a2-57dd-421c-aaeb-7b2030a51246] Received unexpected event network-vif-plugged-2801d863-dcfc-4a6a-bc26-1bd5b1575685 for instance with vm_state deleted and task_state None.
Nov 03 17:33:43 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Deleted allocations for instance affef3a2-57dd-421c-aaeb-7b2030a51246
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a249656b-2c63-4c5c-bc74-bf4a1f5cadec tempest-VolumesAssistedSnapshotsTest-440291304 tempest-VolumesAssistedSnapshotsTest-440291304-project-member] Lock "affef3a2-57dd-421c-aaeb-7b2030a51246" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:33:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:44 user nova-compute[75463]: WARNING nova.compute.manager [req-803230d2-4754-40f7-be85-76fc303e296c req-ec0b0842-bb3e-4d1d-b768-cd38e60b94d7 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state rescuing.
Nov 03 17:33:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance destroyed successfully.
Nov 03 17:33:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Attempting rescue
Nov 03 17:33:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75463) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 17:33:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Creating image(s)
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'trusted_certs' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue" returned: 0 in 0.054s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'migration_context' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.base [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<c79148db-7d6f-4a58-8e75-ead5b154c335> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start _get_guest_xml network_info=[{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:81:a5:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.base [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<c79148db-7d6f-4a58-8e75-ead5b154c335> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'numa_topology' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.base [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<c79148db-7d6f-4a58-8e75-ead5b154c335> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:45 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:45 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'vcpu_model' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.base [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<c79148db-7d6f-4a58-8e75-ead5b154c335> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425014350',display_name='tempest-ServerRescueNegativeTestJSON-server-1425014350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425014350',id=3,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-dd0gp0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:29:12Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=c79148db-7d6f-4a58-8e75-ead5b154c335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:81:a5:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:81:a5:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.objects.base [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<c79148db-7d6f-4a58-8e75-ead5b154c335> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:33:45 user nova-compute[75463]:   <uuid>c79148db-7d6f-4a58-8e75-ead5b154c335</uuid>
Nov 03 17:33:45 user nova-compute[75463]:   <name>instance-00000003</name>
Nov 03 17:33:45 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:33:45 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:33:45 user nova-compute[75463]:   <metadata>
Nov 03 17:33:45 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:33:45 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1425014350</nova:name>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:33:45</nova:creationTime>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:33:45 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:33:45 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:owner>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:33:45 user nova-compute[75463]:       </nova:owner>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:33:45 user nova-compute[75463]:       <nova:ports>
Nov 03 17:33:45 user nova-compute[75463]:         <nova:port uuid="b2fab86b-cc7b-4661-8776-e89a08742f23">
Nov 03 17:33:45 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:33:45 user nova-compute[75463]:         </nova:port>
Nov 03 17:33:45 user nova-compute[75463]:       </nova:ports>
Nov 03 17:33:45 user nova-compute[75463]:     </nova:instance>
Nov 03 17:33:45 user nova-compute[75463]:   </metadata>
Nov 03 17:33:45 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:33:45 user nova-compute[75463]:     <system>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="serial">c79148db-7d6f-4a58-8e75-ead5b154c335</entry>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="uuid">c79148db-7d6f-4a58-8e75-ead5b154c335</entry>
Nov 03 17:33:45 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:33:45 user nova-compute[75463]:     </system>
Nov 03 17:33:45 user nova-compute[75463]:   </sysinfo>
Nov 03 17:33:45 user nova-compute[75463]:   <os>
Nov 03 17:33:45 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:33:45 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:33:45 user nova-compute[75463]:   </os>
Nov 03 17:33:45 user nova-compute[75463]:   <features>
Nov 03 17:33:45 user nova-compute[75463]:     <acpi/>
Nov 03 17:33:45 user nova-compute[75463]:     <apic/>
Nov 03 17:33:45 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:33:45 user nova-compute[75463]:   </features>
Nov 03 17:33:45 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:33:45 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:33:45 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:33:45 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:33:45 user nova-compute[75463]:   </clock>
Nov 03 17:33:45 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:33:45 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:33:45 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:33:45 user nova-compute[75463]:   </cpu>
Nov 03 17:33:45 user nova-compute[75463]:   <devices>
Nov 03 17:33:45 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:33:45 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:33:45 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue"/>
Nov 03 17:33:45 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:33:45 user nova-compute[75463]:     </disk>
Nov 03 17:33:45 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:33:45 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:33:45 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk"/>
Nov 03 17:33:45 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:33:45 user nova-compute[75463]:     </disk>
Nov 03 17:33:45 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:33:45 user nova-compute[75463]:       <mac address="fa:16:3e:81:a5:56"/>
Nov 03 17:33:45 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:33:45 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:33:45 user nova-compute[75463]:       <target dev="tapb2fab86b-cc"/>
Nov 03 17:33:45 user nova-compute[75463]:     </interface>
Nov 03 17:33:45 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:33:45 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/console.log" append="off"/>
Nov 03 17:33:45 user nova-compute[75463]:     </serial>
Nov 03 17:33:45 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:33:45 user nova-compute[75463]:     <video>
Nov 03 17:33:45 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:33:45 user nova-compute[75463]:     </video>
Nov 03 17:33:45 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:33:45 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:33:45 user nova-compute[75463]:     </rng>
Nov 03 17:33:45 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:33:45 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:33:45 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:33:45 user nova-compute[75463]:     </memballoon>
Nov 03 17:33:45 user nova-compute[75463]:   </devices>
Nov 03 17:33:45 user nova-compute[75463]: </domain>
Nov 03 17:33:45 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:33:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance destroyed successfully.
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:33:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:81:a5:56, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:33:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:46 user nova-compute[75463]: WARNING nova.compute.manager [req-b30bbce1-e042-4189-8557-bac7d1642794 req-27b5788e-aff2-48a9-9b97-0a3adba3bb88 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state rescuing.
Nov 03 17:33:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:48 user nova-compute[75463]: WARNING nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state rescuing.
Nov 03 17:33:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:33:48 user nova-compute[75463]: WARNING nova.compute.manager [req-1920014d-cabe-4ba4-b28f-d6b280a0f794 req-2e0bf9c6-1223-459d-ad44-0ee64d37a2f6 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state active and task_state rescuing.
Nov 03 17:33:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7dae9ab0-12a8-4302-85a6-44a656c0daba tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:33:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '15a044ce-baca-4835-bbe9-480ef8795e46', 'serial': '15a044ce-baca-4835-bbe9-480ef8795e46'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4'}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'serial'} {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:54 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:54 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:54 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee05845-14d3-4bbc-9d05-b254ca1d9106]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:33:54 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd4c829-2d40-4033-b21d-f4622c4390ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46] added
Nov 03 17:33:54 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[55813036-b34a-4b90-842e-1b2953254e02]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7f230-d378-496c-bbf2-ab37fd66c0f5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfBysQOK {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfBysQOK" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03de7e-c1a4-4cc7-bf22-67536b081994]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfBysQOK'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[589177dc-15e3-4f87-a40a-8609ef8e051f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec06c95-4269-4739-b087-d9d4b44adb52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d31ae3-a8f3-4e66-a983-9d048a3eedf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]
Nov 03 17:33:55 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.
Nov 03 17:33:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f093c545-a1da-491c-927e-a49285a60524]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[929e2570-a5bd-478d-a74c-3ef642869347]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901d3d4-4fb2-42d7-851f-e3c6b8c86e1a]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:33:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:33:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23332306634333733', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:33:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332306634333733', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:33:56 user nova-compute[75463]: DEBUG nova.objects.instance [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lazy-loading 'flavor' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 166723584 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:33:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 334495744 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 499122176 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 796917760 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:33:59 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Creating image(s)
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Ensure instance console log exists: /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start _get_guest_xml network_info=[{"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '934190b6-f35a-4a1e-8e5e-3c76137f9f73', 'attached_at': '', 'detached_at': '', 'volume_id': '5f8552c3-a6cd-4a56-8643-c73eef62e850', 'serial': '5f8552c3-a6cd-4a56-8643-c73eef62e850'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'e9fa3486-4cec-4b9d-acad-476819e5f8dd', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:33:59 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 17:33:59 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 934190b6-f35a-4a1e-8e5e-3c76137f9f73 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:33:59 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:59 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:33:59 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[481137a1-b8ad-494a-8aee-39093edf6af1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:33:59 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60cb7cd-19f5-4e92-8d78-c25ecd0e23cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850] added
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 951058432 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b4dc1-b0da-4d91-8b85-e196b22148df]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ae96ed-bead-4a86-8fa4-91b759a1cd43]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIvTnJZp {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIvTnJZp" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c11a7f-32c2-476a-bc14-978832448e64]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIvTnJZp'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a61a6-a199-4f40-8f27-c641f4a06652]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617c9b0-657d-4513-9829-3875febfd251]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[69905c45-6d3e-4b63-bef4-2b3133e405b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]
Nov 03 17:33:59 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950d1d2-1a69-4360-9285-93de6b765842]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa8f49-1c7f-40f9-80ef-32c652511cfd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:33:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:33:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c35e817-ce53-457c-826e-9659b12d415d]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:34:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgTHFibj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '7aa990b6-745f-4c6d-9121-a2720d84e8a4'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:34:00 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:34:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26232373363646434', 'path': '/dev/sde'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232373363646434', 'path': '/dev/sde'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.710s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f8ec3-a964-4f39-b6e3-1cc78ee8264d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:34:01 user nova-compute[75463]: No targets found.
Nov 03 17:34:01 user nova-compute[75463]: iSNS:
Nov 03 17:34:01 user nova-compute[75463]: No targets found.
Nov 03 17:34:01 user nova-compute[75463]: STATIC:
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:34:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:01 user nova-compute[75463]: FIRMWARE:
Nov 03 17:34:01 user nova-compute[75463]: No targets found.
Nov 03 17:34:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:34:01 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:34:01 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471355234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:34:01 user nova-compute[75463]:   <uuid>934190b6-f35a-4a1e-8e5e-3c76137f9f73</uuid>
Nov 03 17:34:01 user nova-compute[75463]:   <name>instance-0000000b</name>
Nov 03 17:34:01 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:34:01 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:34:01 user nova-compute[75463]:   <metadata>
Nov 03 17:34:01 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:34:01 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:34:01 user nova-compute[75463]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1471355234</nova:name>
Nov 03 17:34:01 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:33:59</nova:creationTime>
Nov 03 17:34:01 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:34:01 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:34:01 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:34:01 user nova-compute[75463]:       <nova:owner>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:user uuid="eb8d92159473468e9a75ed0a90d9ec10">tempest-ServerActionsV293TestJSON-322207706-project-member</nova:user>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:project uuid="462cbd38529a42029b3f65c2db8425bb">tempest-ServerActionsV293TestJSON-322207706</nova:project>
Nov 03 17:34:01 user nova-compute[75463]:       </nova:owner>
Nov 03 17:34:01 user nova-compute[75463]:       <nova:ports>
Nov 03 17:34:01 user nova-compute[75463]:         <nova:port uuid="1b4e3c7e-d09d-492f-9615-eea70a3106f6">
Nov 03 17:34:01 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 17:34:01 user nova-compute[75463]:         </nova:port>
Nov 03 17:34:01 user nova-compute[75463]:       </nova:ports>
Nov 03 17:34:01 user nova-compute[75463]:     </nova:instance>
Nov 03 17:34:01 user nova-compute[75463]:   </metadata>
Nov 03 17:34:01 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:34:01 user nova-compute[75463]:     <system>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="serial">934190b6-f35a-4a1e-8e5e-3c76137f9f73</entry>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="uuid">934190b6-f35a-4a1e-8e5e-3c76137f9f73</entry>
Nov 03 17:34:01 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:34:01 user nova-compute[75463]:     </system>
Nov 03 17:34:01 user nova-compute[75463]:   </sysinfo>
Nov 03 17:34:01 user nova-compute[75463]:   <os>
Nov 03 17:34:01 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:34:01 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:34:01 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:34:01 user nova-compute[75463]:   </os>
Nov 03 17:34:01 user nova-compute[75463]:   <features>
Nov 03 17:34:01 user nova-compute[75463]:     <acpi/>
Nov 03 17:34:01 user nova-compute[75463]:     <apic/>
Nov 03 17:34:01 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:34:01 user nova-compute[75463]:   </features>
Nov 03 17:34:01 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:34:01 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:34:01 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:34:01 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:34:01 user nova-compute[75463]:   </clock>
Nov 03 17:34:01 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:34:01 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:34:01 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:34:01 user nova-compute[75463]:   </cpu>
Nov 03 17:34:01 user nova-compute[75463]:   <devices>
Nov 03 17:34:01 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:34:01 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:34:01 user nova-compute[75463]:       <source dev="/dev/sde"/>
Nov 03 17:34:01 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:34:01 user nova-compute[75463]:       <serial>5f8552c3-a6cd-4a56-8643-c73eef62e850</serial>
Nov 03 17:34:01 user nova-compute[75463]:     </disk>
Nov 03 17:34:01 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:34:01 user nova-compute[75463]:       <mac address="fa:16:3e:26:3e:53"/>
Nov 03 17:34:01 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:34:01 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:34:01 user nova-compute[75463]:       <target dev="tap1b4e3c7e-d0"/>
Nov 03 17:34:01 user nova-compute[75463]:     </interface>
Nov 03 17:34:01 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:34:01 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73/console.log" append="off"/>
Nov 03 17:34:01 user nova-compute[75463]:     </serial>
Nov 03 17:34:01 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:34:01 user nova-compute[75463]:     <video>
Nov 03 17:34:01 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:34:01 user nova-compute[75463]:     </video>
Nov 03 17:34:01 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:34:01 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:34:01 user nova-compute[75463]:     </rng>
Nov 03 17:34:01 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:34:01 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:34:01 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:34:01 user nova-compute[75463]:     </memballoon>
Nov 03 17:34:01 user nova-compute[75463]:   </devices>
Nov 03 17:34:01 user nova-compute[75463]: </domain>
Nov 03 17:34:01 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471355234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baefaa5-e2ce-484e-9c9d-b20d13b6fb83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '159ebf13-3a74-569f-9c4b-17461a407aa7', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b4e3c7e-d0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b4e3c7e-d0, col_values=(('qos', UUID('830f1d6c-38da-4541-bf34-e96759980d87')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b4e3c7e-d0, col_values=(('external_ids', {'iface-id': '1b4e3c7e-d09d-492f-9615-eea70a3106f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3e:53', 'vm-uuid': '934190b6-f35a-4a1e-8e5e-3c76137f9f73'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:01 user nova-compute[75463]: INFO os_vif [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0')
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe4ff4a-bca5-44d4-bb03-a981939cb2cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:34:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec5ece50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd51de0-cad9-4c27-ad16-e1aea50b252f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] No VIF found with MAC fa:16:3e:26:3e:53, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ff8db9-453b-4a74-9ecb-f31a4899a55e]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96ac07a-45d7-460a-8cea-aa718b78f120]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[337c19dd-3e8b-4821-b477-e21aa2e7d8d2]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d695e72-9497-4a5d-91d5-57acb8d5407d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2abb659-0315-4e8e-886a-0ca080e874f9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260]
Nov 03 17:34:01 user nova-compute[75463]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4, portal: 172.16.0.220,3260] successful.
Nov 03 17:34:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aa990b6-745f-4c6d-9121-a2720d84e8a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4768a-96a3-4d7a-8af2-a920e1832cd2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] <== disconnect_volume: return (1059ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aa42692c-c217-41b8-a584-c9b33686c643', 'attached_at': '', 'detached_at': '', 'volume_id': '15a044ce-baca-4835-bbe9-480ef8795e46', 'serial'} {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 03 17:34:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: removing Cinder connection for volume 7aa990b6-745f-4c6d-9121-a2720d84e8a4 {{(pid=75463) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:02 user nova-compute[75463]: WARNING nova.compute.manager [req-bddf60ae-e869-478f-acca-c208422d3b34 req-ae70840c-e44c-49ef-b353-d2bf256d773a service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating instance_info_cache with network_info: [{"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-8068fdfb-ac16-4213-8152-885a91e37616" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:34:04 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance spawned successfully.
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:04 user nova-compute[75463]: WARNING nova.compute.manager [req-c384fbd5-979b-4884-96a3-ec13843b5ceb req-9103d462-69be-4546-9854-7bc438b9ca19 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state rebuild_spawning.
Nov 03 17:34:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75463) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f0461dfd-d4d6-4bb1-a7a5-79c76051baac tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=25.307662963867188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7a12db62-26a6-47fa-906c-d92f67e08084 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7158723b-e605-4046-8352-d0cf7ee1e9ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:10 user nova-compute[75463]: INFO nova.compute.manager [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Terminating instance
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-unplugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-unplugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-46a780b1-370a-48c0-b39b-6dd5c44ccd4f req-0fa6579b-1dec-4bbd-a738-9240fae80d79 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-unplugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] [instance: aa42692c-c217-41b8-a584-c9b33686c643] swap_volume: Updating volume 7aa990b6-745f-4c6d-9121-a2720d84e8a4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rfBysQOK", "auth_password": "YXDHPAaWqhsoO8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "15a044ce-baca-4835-bbe9-480ef8795e46"}, "status": "reserved", "instance": "aa42692c-c217-41b8-a584-c9b33686c643", "attached_at": "", "detached_at": "", "volume_id": "15a044ce-baca-4835-bbe9-480ef8795e46", "serial": "15a044ce-baca-4835-bbe9-480ef8795e46"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '15a044ce-baca-4835-bbe9-480ef8795e46', 'no_device': None, 'attachment_id': '3097c584-2191-4dd7-a289-d8a076be9720'} {{(pid=75463) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-abe684f4-f539-421f-a182-0e87b78e63d9 tempest-TestVolumeSwap-394438266 tempest-TestVolumeSwap-394438266-project-admin] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 42.692s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Instance destroyed successfully.
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lazy-loading 'resources' on Instance uuid 3394c83b-9dc5-44a5-8af9-122da4f80233 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583190705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583190705',id=6,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPNQQzriZwl0VS2rdOfyWVlcbS8tfwAPR0wKxVdMyinhKbReLbhme2zQyPsbmf2AwHccv7dvYd9ro2iQeHzwuQyzbNmSZlf0zHrI7Kggl3pGtySWfdZNRPQayihi7Jngw==',key_name='tempest-keypair-944920377',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2f7989faf6b4c08b25287cd6fb74ab4',ramdisk_id='',reservation_id='r-tbtlfem6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-901062206',owner_user_name='tempest-TaggedAttachmentsTest-901062206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7015a1cbbd024518b9590d2561dc02db',uuid=3394c83b-9dc5-44a5-8af9-122da4f80233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converting VIF {"id": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "address": "fa:16:3e:d6:09:cb", "network": {"id": "d0a17187-19db-467b-9ac6-f818a0f85d03", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1673314134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2f7989faf6b4c08b25287cd6fb74ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a83cf1d-0d", "ovs_interfaceid": "7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG os_vif [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a83cf1d-0d, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=390b0944-3328-4cab-8c8a-c6ef16a8f908) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:11 user nova-compute[75463]: INFO os_vif [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1,network=Network(d0a17187-19db-467b-9ac6-f818a0f85d03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a83cf1d-0d')
Nov 03 17:34:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Deleting instance files /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233_del
Nov 03 17:34:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Deletion of /opt/stack/data/nova/instances/3394c83b-9dc5-44a5-8af9-122da4f80233_del complete
Nov 03 17:34:11 user nova-compute[75463]: INFO nova.compute.manager [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 03 17:34:11 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:34:11 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:12 user nova-compute[75463]: INFO nova.compute.manager [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Detaching volume 15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:12 user nova-compute[75463]: INFO nova.virt.block_device [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Attempting to driver detach volume 15a044ce-baca-4835-bbe9-480ef8795e46 from mountpoint /dev/vdb
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Attempting to detach device vdb from instance aa42692c-c217-41b8-a584-c9b33686c643 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:34:12 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:34:12 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:34:12 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:34:12 user nova-compute[75463]:   <serial>15a044ce-baca-4835-bbe9-480ef8795e46</serial>
Nov 03 17:34:12 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:34:12 user nova-compute[75463]: </disk>
Nov 03 17:34:12 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Successfully detached device vdb from instance aa42692c-c217-41b8-a584-c9b33686c643 from the persistent domain config.
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa42692c-c217-41b8-a584-c9b33686c643 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:34:12 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:34:12 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:34:12 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:34:12 user nova-compute[75463]:   <serial>15a044ce-baca-4835-bbe9-480ef8795e46</serial>
Nov 03 17:34:12 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:34:12 user nova-compute[75463]: </disk>
Nov 03 17:34:12 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-b7db8b34-ebf0-4952-8aa7-b3c2f56ce559 req-026f5f79-0f36-4932-8f79-f59eafde90c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-deleted-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:12 user nova-compute[75463]: INFO nova.compute.manager [req-b7db8b34-ebf0-4952-8aa7-b3c2f56ce559 req-026f5f79-0f36-4932-8f79-f59eafde90c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Neutron deleted interface 7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1; detaching it from the instance and deleting it from the info cache
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.network.neutron [req-b7db8b34-ebf0-4952-8aa7-b3c2f56ce559 req-026f5f79-0f36-4932-8f79-f59eafde90c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Took 0.92 seconds to deallocate network for instance.
Nov 03 17:34:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-b7db8b34-ebf0-4952-8aa7-b3c2f56ce559 req-026f5f79-0f36-4932-8f79-f59eafde90c6 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Detach interface failed, port_id=7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1, reason: Instance 3394c83b-9dc5-44a5-8af9-122da4f80233 could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:13 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Deleted allocations for instance 3394c83b-9dc5-44a5-8af9-122da4f80233
Nov 03 17:34:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] Acquiring lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] No waiting events found dispatching network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:13 user nova-compute[75463]: WARNING nova.compute.manager [req-df7aeb74-b53b-41a9-83b2-8372b19b824c req-28563267-9290-405e-b461-16bc826a1927 service nova] [instance: 3394c83b-9dc5-44a5-8af9-122da4f80233] Received unexpected event network-vif-plugged-7a83cf1d-0d5c-45ff-9791-a00e7cdaf2b1 for instance with vm_state deleted and task_state None.
Nov 03 17:34:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9239d333-2a21-4744-a8d7-47c2c1787e6d tempest-TaggedAttachmentsTest-901062206 tempest-TaggedAttachmentsTest-901062206-project-member] Lock "3394c83b-9dc5-44a5-8af9-122da4f80233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-changed-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing instance network info cache due to event network-changed-5f9b73f9-a93e-48f3-bbef-0be495c7e08a. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:34:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] Acquiring lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] Acquired lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:14 user nova-compute[75463]: DEBUG nova.network.neutron [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Refreshing network info cache for port 5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:34:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updated VIF entry in instance network info cache for port 5f9b73f9-a93e-48f3-bbef-0be495c7e08a. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:34:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c28e718c-7599-4dc7-a1ed-6ea31720ba89 req-2ba41f9c-dbf7-403d-b4a2-2cb8d7a57bc7 service nova] Releasing lock "refresh_cache-7a12db62-26a6-47fa-906c-d92f67e08084" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:34:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:17 user nova-compute[75463]: INFO nova.compute.manager [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Terminating instance
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-127bb1b2-9be5-4723-93be-a1430378af4a req-d970d35a-72ad-4a11-8032-d2ded65c034f service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-de46eb4b-8645-4cf2-9535-9bb52f4e5e1b req-041815d6-472d-4aba-8561-1f0fb0567ace service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-f6e09608-7263-46ee-8898-871823941b01 req-b2c221d5-49ae-455d-9347-5164543d2b10 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Instance destroyed successfully.
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lazy-loading 'resources' on Instance uuid 7a12db62-26a6-47fa-906c-d92f67e08084 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9b73f9-a9, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=651efe5a-4671-44fc-a1e2-080dd918f8c1) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9d:b7,bridge_name='br-int',has_traffic_filtering=True,id=5f9b73f9-a93e-48f3-bbef-0be495c7e08a,network=Network(67948401-23c1-4f60-b0d1-a651ed1eb88d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9b73f9-a9')
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88afdc4c-f0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bc18a8d-fea1-40f2-b134-609af8ab837d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:62:6b,bridge_name='br-int',has_traffic_filtering=True,id=88afdc4c-f0ce-41f0-80ec-91d526a8329f,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap88afdc4c-f0')
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8076f1d6-eb, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: WARNING nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-5f9b73f9-a93e-48f3-bbef-0be495c7e08a for instance with vm_state active and task_state deleting.
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-ffa18fac-3162-43af-a550-254a6e897464 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: WARNING nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-ffa18fac-3162-43af-a550-254a6e897464 for instance with vm_state active and task_state deleting.
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-769ebb0a-75f2-4063-8537-e36895b29b22 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: WARNING nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-769ebb0a-75f2-4063-8537-e36895b29b22 for instance with vm_state active and task_state deleting.
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:19 user nova-compute[75463]: WARNING nova.compute.manager [req-44cdf56b-1a87-414d-ad4e-2395bb0aac7c req-c458bd9c-975c-4265-bd0f-e08590c7cbb3 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-a16f54e0-444b-4e24-8bab-162e0d3fb29e for instance with vm_state active and task_state deleting.
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70a57f68-beae-4566-8330-880ff9eb0992) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:cd:c0,bridge_name='br-int',has_traffic_filtering=True,id=8076f1d6-eb6d-4430-b601-1aad292f8cb2,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8076f1d6-eb')
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffa18fac-31, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58a1ed6d-1755-44d1-91c8-0275683ffdf6) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:86:d1,bridge_name='br-int',has_traffic_filtering=True,id=ffa18fac-3162-43af-a550-254a6e897464,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffa18fac-31')
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap769ebb0a-75, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8347f60c-a2fc-42b3-b220-609e810ca7e4) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=769ebb0a-75f2-4063-8537-e36895b29b22,network=Network(4359fc45-610f-4b50-9cf5-34cdda40af69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap769ebb0a-75')
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "d405e3ff-75b9-4ef2-8071-08751d53f470", "address": "fa:16:3e:e4:5a:97", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd405e3ff-75", "ovs_interfaceid": "d405e3ff-75b9-4ef2-8071-08751d53f470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd405e3ff-75, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-88afdc4c-f0ce-41f0-80ec-91d526a8329f for instance with vm_state active and task_state deleting.
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-unplugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-unplugged-d405e3ff-75b9-4ef2-8071-08751d53f470 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING nova.compute.manager [req-08fba0c0-8e49-4989-b450-3bbfe448b750 req-bcc79840-02cd-4aec-bcfa-6361cdd018ad service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-d405e3ff-75b9-4ef2-8071-08751d53f470 for instance with vm_state active and task_state deleting.
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=870496a0-87a0-49f4-8c13-51e845abb8fe) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=d405e3ff-75b9-4ef2-8071-08751d53f470,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd405e3ff-75')
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-903351217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-903351217',id=12,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+q5ybWUEoSRObK00uEGeEFCFpCURm92hHasYHOwYLz4ZnLtWCKk9goqd2EvXFoiBrH8ht/PPOsT1/ylZX9iTDdmo27DQqFT0PU43+HLCuuwZWyRpTEEXgAnVD6ZzfgDw==',key_name='tempest-keypair-542945504',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9a0d997a83745debe050f94c1896711',ramdisk_id='',reservation_id='r-ehlspctm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-960766363',owner_user_name='tempest-TaggedBootDevicesTest_v242-960766363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb7e9c88f7ab4fb7b205452ec24c75f3',uuid=7a12db62-26a6-47fa-906c-d92f67e08084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converting VIF {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa16f54e0-44, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95816240-ff15-4b5f-ae41-0e0ba64434a0) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:20 user nova-compute[75463]: INFO os_vif [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:00:b6,bridge_name='br-int',has_traffic_filtering=True,id=a16f54e0-444b-4e24-8bab-162e0d3fb29e,network=Network(5496008f-1b59-424e-8ebc-f80314eed65c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16f54e0-44')
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPopRQzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] Acquiring lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] Lock "7a12db62-26a6-47fa-906c-d92f67e08084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] No waiting events found dispatching network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING nova.compute.manager [req-85f5f0c0-7d34-4999-9d94-c380f824c8e5 req-299500cd-55fa-4025-80ac-a51d401f3b78 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received unexpected event network-vif-plugged-8076f1d6-eb6d-4430-b601-1aad292f8cb2 for instance with vm_state active and task_state deleting.
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac3aae-f10b-4475-bf45-430267f3cf50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: iSNS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: STATIC:
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: FIRMWARE:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:34:20 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9781b53-2d2e-494d-88be-91a5d556bfe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5810ccf-42f9-4e3b-919b-c28c797e70f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec59f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0560e37-006b-4926-820f-8d36fc960779]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f2c3fe-c5da-420d-845a-b0bd6f7e896f]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c4176-76f6-4d2a-abd3-76c25db2ce02]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf0d044-65b9-4496-b862-b97d28c97d46]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[05020ead-04ba-4295-8722-ff3b62e8372a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a9537-cb36-4ff7-9bbd-fe255f3726b6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260]
Nov 03 17:34:20 user nova-compute[75463]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950, portal: 172.16.0.220,3260] successful.
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3c2be4e-e4ec-4b4a-a3ff-392d55ddf950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3836f31-baf0-4c42-afc2-7bbe17f54e63]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== disconnect_volume: return (382ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EdzheoQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d10667-0a39-4a29-a1b1-0c7748f27256]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: iSNS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: STATIC:
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: FIRMWARE:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:34:20 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519831c-c4bd-444f-9c78-7c7e632b6969]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6bcf3a-7d67-4b37-ab67-904d797401ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec481000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554'): ({'sdg'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Removing single pathed devices sdg {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e4da47-771f-40bd-bfc0-d1924eaad169]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a88df-02c6-4659-b745-10a50ac53a13]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Flushing IO for device /dev/sdg {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272d3ab-7f31-43d2-a9c7-e60f79e115d8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f81a9-554d-45b3-ac26-8e6fccee69ca]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca86add-dc43-48c9-916b-2c907b8193ec]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da012ab0-f370-452c-b4d1-4df04c575db9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260]
Nov 03 17:34:20 user nova-compute[75463]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554, portal: 172.16.0.220,3260] successful.
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc6b6d7a-fcf3-4107-a613-de6eb5ffb554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd6b8c-3f9c-442b-bdec-08b10a24727f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== disconnect_volume: return (314ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEylPmgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:34:20 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70eaa2c-307c-4dd0-9756-51129b700e62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: iSNS:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]: STATIC:
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:20 user nova-compute[75463]: FIRMWARE:
Nov 03 17:34:20 user nova-compute[75463]: No targets found.
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:34:20 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:34:20 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f92aa34-5a28-4441-b6d1-607ee78e7937]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[199e0529-57f7-404f-91ac-98c3baa4d3b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec481000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2'): ({'sdh'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Removing single pathed devices sdh {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e6de22-4013-4378-91c1-83467a7bbf12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d40332a-8f67-4100-9679-e602411cf3ec]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Flushing IO for device /dev/sdh {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a34def-56f5-4c75-bd86-c3272461d14b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[35323117-c3db-40c8-94f8-6ae1fd229417]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] SCSI volumes sdh have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed77f0-ec92-4446-a547-2267d4c5b04c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ea24b-fc09-41af-a591-deab21b00017]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260]
Nov 03 17:34:21 user nova-compute[75463]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2, portal: 172.16.0.220,3260] successful.
Nov 03 17:34:21 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f95d95-9309-4431-a211-2f9d6cd6cfe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f49284d-a459-4d4f-8e49-c5ddbdd12545]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] <== disconnect_volume: return (322ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:34:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Deleting instance files /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084_del
Nov 03 17:34:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Deletion of /opt/stack/data/nova/instances/7a12db62-26a6-47fa-906c-d92f67e08084_del complete
Nov 03 17:34:21 user nova-compute[75463]: INFO nova.compute.manager [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Took 3.80 seconds to destroy the instance on the hypervisor.
Nov 03 17:34:21 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:34:21 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:34:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-9426588d-2aae-45e5-b4f2-e9b6886f701f req-7b90b61c-9992-4b17-b1e5-4d2a7692ba74 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-deleted-d405e3ff-75b9-4ef2-8071-08751d53f470 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:22 user nova-compute[75463]: INFO nova.compute.manager [req-9426588d-2aae-45e5-b4f2-e9b6886f701f req-7b90b61c-9992-4b17-b1e5-4d2a7692ba74 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Neutron deleted interface d405e3ff-75b9-4ef2-8071-08751d53f470; detaching it from the instance and deleting it from the info cache
Nov 03 17:34:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-9426588d-2aae-45e5-b4f2-e9b6886f701f req-7b90b61c-9992-4b17-b1e5-4d2a7692ba74 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [{"id": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "address": "fa:16:3e:ea:9d:b7", "network": {"id": "67948401-23c1-4f60-b0d1-a651ed1eb88d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-112542519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9b73f9-a9", "ovs_interfaceid": "5f9b73f9-a93e-48f3-bbef-0be495c7e08a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "address": "fa:16:3e:17:62:6b", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88afdc4c-f0", "ovs_interfaceid": "88afdc4c-f0ce-41f0-80ec-91d526a8329f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "address": "fa:16:3e:cb:cd:c0", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8076f1d6-eb", "ovs_interfaceid": "8076f1d6-eb6d-4430-b601-1aad292f8cb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ffa18fac-3162-43af-a550-254a6e897464", "address": "fa:16:3e:5c:86:d1", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffa18fac-31", "ovs_interfaceid": "ffa18fac-3162-43af-a550-254a6e897464", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "769ebb0a-75f2-4063-8537-e36895b29b22", "address": "fa:16:3e:5f:b6:fc", "network": {"id": "4359fc45-610f-4b50-9cf5-34cdda40af69", "bridge": "br-int", "label": "tempest-device-tagging-net1-353500626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap769ebb0a-75", "ovs_interfaceid": "769ebb0a-75f2-4063-8537-e36895b29b22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "address": "fa:16:3e:b0:00:b6", "network": {"id": "5496008f-1b59-424e-8ebc-f80314eed65c", "bridge": "br-int", "label": "tempest-device-tagging-net2-193878605", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9a0d997a83745debe050f94c1896711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16f54e0-44", "ovs_interfaceid": "a16f54e0-444b-4e24-8bab-162e0d3fb29e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-9426588d-2aae-45e5-b4f2-e9b6886f701f req-7b90b61c-9992-4b17-b1e5-4d2a7692ba74 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Detach interface failed, port_id=d405e3ff-75b9-4ef2-8071-08751d53f470, reason: Instance 7a12db62-26a6-47fa-906c-d92f67e08084 could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:34:24 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:24 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Took 3.62 seconds to deallocate network for instance.
Nov 03 17:34:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-c72bfead-f5a0-4632-bbe7-0f4413d9d66a req-84ae9d6e-9e4e-4be5-970e-e065d336c2a9 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-deleted-769ebb0a-75f2-4063-8537-e36895b29b22 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-c72bfead-f5a0-4632-bbe7-0f4413d9d66a req-84ae9d6e-9e4e-4be5-970e-e065d336c2a9 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-deleted-ffa18fac-3162-43af-a550-254a6e897464 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-c72bfead-f5a0-4632-bbe7-0f4413d9d66a req-84ae9d6e-9e4e-4be5-970e-e065d336c2a9 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-deleted-a16f54e0-444b-4e24-8bab-162e0d3fb29e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-c72bfead-f5a0-4632-bbe7-0f4413d9d66a req-84ae9d6e-9e4e-4be5-970e-e065d336c2a9 service nova] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Received event network-vif-deleted-5f9b73f9-a93e-48f3-bbef-0be495c7e08a {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:27 user nova-compute[75463]: INFO nova.compute.manager [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] [instance: 7a12db62-26a6-47fa-906c-d92f67e08084] Took 2.90 seconds to detach 3 volumes for instance.
Nov 03 17:34:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:28 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:28 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:28 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Deleted allocations for instance 7a12db62-26a6-47fa-906c-d92f67e08084
Nov 03 17:34:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5b4c6838-78e6-497a-9047-e5a68d515c86 tempest-TaggedBootDevicesTest_v242-960766363 tempest-TaggedBootDevicesTest_v242-960766363-project-member] Lock "7a12db62-26a6-47fa-906c-d92f67e08084" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.862s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aa42692c-c217-41b8-a584-c9b33686c643 is timed out.
Nov 03 17:34:33 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Successfully detached device vdb from instance aa42692c-c217-41b8-a584-c9b33686c643 from the live domain config.
Nov 03 17:34:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfBysQOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '15a044ce-baca-4835-bbe9-480ef8795e46'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:34:33 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5365c19-9199-4846-a38f-23aaaeb7a719]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:34:33 user nova-compute[75463]: No targets found.
Nov 03 17:34:33 user nova-compute[75463]: iSNS:
Nov 03 17:34:33 user nova-compute[75463]: No targets found.
Nov 03 17:34:33 user nova-compute[75463]: STATIC:
Nov 03 17:34:33 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:34:33 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:33 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:33 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46
Nov 03 17:34:33 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:34:33 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:34:33 user nova-compute[75463]: FIRMWARE:
Nov 03 17:34:33 user nova-compute[75463]: No targets found.
Nov 03 17:34:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:34:33 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:34:33 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa994598-03dd-48e4-85b1-3648ae66c9d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eebba6-f4f1-45c3-a5cf-5b651e2a842e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:33 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 (non-flash)
Nov 03 17:34:33 user nova-compute[75463]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:34:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec422b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6365a85-8957-47ee-b712-422de8661dd1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaccfaa-da7f-41ee-9ee6-f55481246712]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aceb77-977d-442b-af42-ff80bbd9dcdd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f6bbc-2344-49bb-9c43-f0eea30a8d8e]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a12e15-01a8-44f5-82f1-d01da46587f8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ec152-22b5-42c3-a916-57e2484c0930]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260]
Nov 03 17:34:33 user nova-compute[75463]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46, portal: 172.16.0.220,3260] successful.
Nov 03 17:34:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a044ce-baca-4835-bbe9-480ef8795e46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4870c7-1523-4363-a49d-324690d7cdee]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] <== disconnect_volume: return (312ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:34:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:34:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lazy-loading 'flavor' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:34:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7a8c1d27-debb-4ec6-8ea6-3b318dc66ace tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.738s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:34:37 user nova-compute[75463]: INFO nova.compute.manager [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] instance snapshotting
Nov 03 17:34:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Beginning live snapshot process
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc.delta 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc.delta 1073741824" returned: 0 in 0.052s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 17:34:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] COPY block job progress, current cursor: 131072 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:34:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:34:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:34:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 17:34:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:40 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:34:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc.delta /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc.delta /opt/stack/data/nova/instances/snapshots/tmp_ef9s2rp/636104c5871a42b68daafe5c37b008bc" returned: 0 in 0.698s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Snapshot extracted, beginning image upload
Nov 03 17:34:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:34:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Snapshot image upload complete
Nov 03 17:34:44 user nova-compute[75463]: INFO nova.compute.manager [None req-23a47ef7-5dfe-4e1b-8cd5-b323c6f79302 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Took 6.30 seconds to snapshot the instance on the hypervisor.
Nov 03 17:34:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:34:45 user nova-compute[75463]: INFO nova.compute.claims [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Claim successful on node user
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:34:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.policy [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeadce7781c4ef7b888094b5707750a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27744d9d47034ad4bdc36f50bb525282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:34:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Creating image(s)
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "/opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk 1073741824" returned: 0 in 0.052s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Successfully created port: b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Cannot resize image /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Ensure instance console log exists: /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Successfully updated port: b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquired lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-changed-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Refreshing instance network info cache due to event network-changed-b59a1813-92bb-4ed7-af26-edb6f244c21b. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] Acquiring lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Releasing lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Instance network_info: |[{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] Acquired lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Refreshing network info cache for port b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Start _get_guest_xml network_info=[{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:34:47 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:47 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181611941',display_name='tempest-AttachVolumeNegativeTest-server-1181611941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181611941',id=16,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQFFrxq3ZhdAKUuZUXOJ8C90LLjSiNAdZDrtyKvLAM7PmrsUs/VqDkeqz4/T0SOkufhoOq8xG2SWhjs5Z3ysx0xdteq+o6PUDEsRSaSjvU2OjpuP8kuhZAF9rP5zR5wQ==',key_name='tempest-keypair-2080015443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-48j80idc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=034f67dd-4bd4-4414-93b5-c7e77148f8eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'pci_devices' on Instance uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:34:47 user nova-compute[75463]:   <uuid>034f67dd-4bd4-4414-93b5-c7e77148f8eb</uuid>
Nov 03 17:34:47 user nova-compute[75463]:   <name>instance-00000010</name>
Nov 03 17:34:47 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:34:47 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:34:47 user nova-compute[75463]:   <metadata>
Nov 03 17:34:47 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:34:47 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1181611941</nova:name>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:34:47</nova:creationTime>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:34:47 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:34:47 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:owner>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:user uuid="7aeadce7781c4ef7b888094b5707750a">tempest-AttachVolumeNegativeTest-731383677-project-member</nova:user>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:project uuid="27744d9d47034ad4bdc36f50bb525282">tempest-AttachVolumeNegativeTest-731383677</nova:project>
Nov 03 17:34:47 user nova-compute[75463]:       </nova:owner>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:34:47 user nova-compute[75463]:       <nova:ports>
Nov 03 17:34:47 user nova-compute[75463]:         <nova:port uuid="b59a1813-92bb-4ed7-af26-edb6f244c21b">
Nov 03 17:34:47 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:34:47 user nova-compute[75463]:         </nova:port>
Nov 03 17:34:47 user nova-compute[75463]:       </nova:ports>
Nov 03 17:34:47 user nova-compute[75463]:     </nova:instance>
Nov 03 17:34:47 user nova-compute[75463]:   </metadata>
Nov 03 17:34:47 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:34:47 user nova-compute[75463]:     <system>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="serial">034f67dd-4bd4-4414-93b5-c7e77148f8eb</entry>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="uuid">034f67dd-4bd4-4414-93b5-c7e77148f8eb</entry>
Nov 03 17:34:47 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:34:47 user nova-compute[75463]:     </system>
Nov 03 17:34:47 user nova-compute[75463]:   </sysinfo>
Nov 03 17:34:47 user nova-compute[75463]:   <os>
Nov 03 17:34:47 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:34:47 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:34:47 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:34:47 user nova-compute[75463]:   </os>
Nov 03 17:34:47 user nova-compute[75463]:   <features>
Nov 03 17:34:47 user nova-compute[75463]:     <acpi/>
Nov 03 17:34:47 user nova-compute[75463]:     <apic/>
Nov 03 17:34:47 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:34:47 user nova-compute[75463]:   </features>
Nov 03 17:34:47 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:34:47 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:34:47 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:34:47 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:34:47 user nova-compute[75463]:   </clock>
Nov 03 17:34:47 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:34:47 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:34:47 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:34:47 user nova-compute[75463]:   </cpu>
Nov 03 17:34:47 user nova-compute[75463]:   <devices>
Nov 03 17:34:47 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:34:47 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:34:47 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk"/>
Nov 03 17:34:47 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:34:47 user nova-compute[75463]:     </disk>
Nov 03 17:34:47 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:34:47 user nova-compute[75463]:       <mac address="fa:16:3e:2a:da:e5"/>
Nov 03 17:34:47 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:34:47 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:34:47 user nova-compute[75463]:       <target dev="tapb59a1813-92"/>
Nov 03 17:34:47 user nova-compute[75463]:     </interface>
Nov 03 17:34:47 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:34:47 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/console.log" append="off"/>
Nov 03 17:34:47 user nova-compute[75463]:     </serial>
Nov 03 17:34:47 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:34:47 user nova-compute[75463]:     <video>
Nov 03 17:34:47 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:34:47 user nova-compute[75463]:     </video>
Nov 03 17:34:47 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:34:47 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:34:47 user nova-compute[75463]:     </rng>
Nov 03 17:34:47 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:34:47 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:34:47 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:34:47 user nova-compute[75463]:     </memballoon>
Nov 03 17:34:47 user nova-compute[75463]:   </devices>
Nov 03 17:34:47 user nova-compute[75463]: </domain>
Nov 03 17:34:47 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181611941',display_name='tempest-AttachVolumeNegativeTest-server-1181611941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181611941',id=16,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQFFrxq3ZhdAKUuZUXOJ8C90LLjSiNAdZDrtyKvLAM7PmrsUs/VqDkeqz4/T0SOkufhoOq8xG2SWhjs5Z3ysx0xdteq+o6PUDEsRSaSjvU2OjpuP8kuhZAF9rP5zR5wQ==',key_name='tempest-keypair-2080015443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-48j80idc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:34:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=034f67dd-4bd4-4414-93b5-c7e77148f8eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG os_vif [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a496ea63-e964-557c-8631-f2ea5ee1e45b', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb59a1813-92, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb59a1813-92, col_values=(('qos', UUID('ff450be3-abc7-4872-abd7-142b9efc5710')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb59a1813-92, col_values=(('external_ids', {'iface-id': 'b59a1813-92bb-4ed7-af26-edb6f244c21b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:da:e5', 'vm-uuid': '034f67dd-4bd4-4414-93b5-c7e77148f8eb'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:47 user nova-compute[75463]: INFO os_vif [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92')
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:2a:da:e5, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updated VIF entry in instance network info cache for port b59a1813-92bb-4ed7-af26-edb6f244c21b. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:34:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c1e6dc51-abe3-4acc-b676-4006c9483585 req-a1fbe299-1b75-46f1-b5be-7293d92723a1 service nova] Releasing lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating instance_info_cache with network_info: [{"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-8c04ed34-af8a-49b9-99ce-3bb48ef8584b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] No waiting events found dispatching network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:49 user nova-compute[75463]: WARNING nova.compute.manager [req-ba059bf5-15f4-4e60-9c32-c9db0c25ff5f req-86d18dfa-1a11-4909-a747-7585811a49db service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received unexpected event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b for instance with vm_state building and task_state spawning.
Nov 03 17:34:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] No waiting events found dispatching network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:34:51 user nova-compute[75463]: WARNING nova.compute.manager [req-ba585640-9c83-40a5-843f-34bbed4f45af req-e7180555-d4d9-4bd1-8569-4b022a94dfce service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received unexpected event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b for instance with vm_state building and task_state spawning.
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:34:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Instance spawned successfully.
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:34:51 user nova-compute[75463]: INFO nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 03 17:34:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:34:51 user nova-compute[75463]: INFO nova.compute.manager [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Took 6.61 seconds to build instance.
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4b86ad9-a064-4d7c-a40d-7a3512ee316b tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.756s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:56 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:56 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:34:56 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7522MB free_disk=25.31304931640625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:34:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance aa42692c-c217-41b8-a584-c9b33686c643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 7158723b-e605-4046-8352-d0cf7ee1e9ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.976s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:34:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:34:58 user nova-compute[75463]: INFO nova.compute.claims [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Claim successful on node user
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:34:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.policy [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '939dac096b51462687e049004fe3eb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04e2c8b44f54272b2d9e693955fc4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:34:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Creating image(s)
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Successfully created port: b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk 1073741824" returned: 0 in 0.064s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.167s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Cannot resize image /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Ensure instance console log exists: /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Successfully updated port: b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-changed-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing instance network info cache due to event network-changed-b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:34:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance network_info: |[{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing network info cache for port b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start _get_guest_xml network_info=[{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:35:00 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:00 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEvK3WNl4mjZ5kmDZ3gCW61q5s0+za8AnwCv4gF2hOpefVCWrL0iZpfJIE8VYGFMwK4eZHCX36lFJT1FkV6pFyEjhYPnpyIqLommQkDwhaG09NARsAsOOFJNS1/eYLalw==',key_name='tempest-keypair-396563564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_devices' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:35:00 user nova-compute[75463]:   <uuid>fd24ad21-b275-4cf2-8a71-800c72c4b672</uuid>
Nov 03 17:35:00 user nova-compute[75463]:   <name>instance-00000011</name>
Nov 03 17:35:00 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:35:00 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:35:00 user nova-compute[75463]:   <metadata>
Nov 03 17:35:00 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:35:00 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-809221533</nova:name>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:35:00</nova:creationTime>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:35:00 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:35:00 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:owner>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:user uuid="939dac096b51462687e049004fe3eb77">tempest-AttachVolumeShelveTestJSON-2020601692-project-member</nova:user>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:project uuid="a04e2c8b44f54272b2d9e693955fc4ae">tempest-AttachVolumeShelveTestJSON-2020601692</nova:project>
Nov 03 17:35:00 user nova-compute[75463]:       </nova:owner>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:35:00 user nova-compute[75463]:       <nova:ports>
Nov 03 17:35:00 user nova-compute[75463]:         <nova:port uuid="b698a98c-a2d8-489b-acac-035363e3a121">
Nov 03 17:35:00 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:35:00 user nova-compute[75463]:         </nova:port>
Nov 03 17:35:00 user nova-compute[75463]:       </nova:ports>
Nov 03 17:35:00 user nova-compute[75463]:     </nova:instance>
Nov 03 17:35:00 user nova-compute[75463]:   </metadata>
Nov 03 17:35:00 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:35:00 user nova-compute[75463]:     <system>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="serial">fd24ad21-b275-4cf2-8a71-800c72c4b672</entry>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="uuid">fd24ad21-b275-4cf2-8a71-800c72c4b672</entry>
Nov 03 17:35:00 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:35:00 user nova-compute[75463]:     </system>
Nov 03 17:35:00 user nova-compute[75463]:   </sysinfo>
Nov 03 17:35:00 user nova-compute[75463]:   <os>
Nov 03 17:35:00 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:35:00 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:35:00 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:35:00 user nova-compute[75463]:   </os>
Nov 03 17:35:00 user nova-compute[75463]:   <features>
Nov 03 17:35:00 user nova-compute[75463]:     <acpi/>
Nov 03 17:35:00 user nova-compute[75463]:     <apic/>
Nov 03 17:35:00 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:35:00 user nova-compute[75463]:   </features>
Nov 03 17:35:00 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:35:00 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:35:00 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:35:00 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:35:00 user nova-compute[75463]:   </clock>
Nov 03 17:35:00 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:35:00 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:35:00 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:35:00 user nova-compute[75463]:   </cpu>
Nov 03 17:35:00 user nova-compute[75463]:   <devices>
Nov 03 17:35:00 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:35:00 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:35:00 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk"/>
Nov 03 17:35:00 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:35:00 user nova-compute[75463]:     </disk>
Nov 03 17:35:00 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:35:00 user nova-compute[75463]:       <mac address="fa:16:3e:f6:fb:4b"/>
Nov 03 17:35:00 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:35:00 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:35:00 user nova-compute[75463]:       <target dev="tapb698a98c-a2"/>
Nov 03 17:35:00 user nova-compute[75463]:     </interface>
Nov 03 17:35:00 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:35:00 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/console.log" append="off"/>
Nov 03 17:35:00 user nova-compute[75463]:     </serial>
Nov 03 17:35:00 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:35:00 user nova-compute[75463]:     <video>
Nov 03 17:35:00 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:35:00 user nova-compute[75463]:     </video>
Nov 03 17:35:00 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:35:00 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:35:00 user nova-compute[75463]:     </rng>
Nov 03 17:35:00 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:35:00 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:35:00 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:35:00 user nova-compute[75463]:     </memballoon>
Nov 03 17:35:00 user nova-compute[75463]:   </devices>
Nov 03 17:35:00 user nova-compute[75463]: </domain>
Nov 03 17:35:00 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEvK3WNl4mjZ5kmDZ3gCW61q5s0+za8AnwCv4gF2hOpefVCWrL0iZpfJIE8VYGFMwK4eZHCX36lFJT1FkV6pFyEjhYPnpyIqLommQkDwhaG09NARsAsOOFJNS1/eYLalw==',key_name='tempest-keypair-396563564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG os_vif [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c735e454-e056-5ec0-9f92-8f91a186c50f', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb698a98c-a2, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb698a98c-a2, col_values=(('qos', UUID('3500bd0e-d7b7-45cd-87f1-816c347eaacf')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb698a98c-a2, col_values=(('external_ids', {'iface-id': 'b698a98c-a2d8-489b-acac-035363e3a121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:fb:4b', 'vm-uuid': 'fd24ad21-b275-4cf2-8a71-800c72c4b672'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:00 user nova-compute[75463]: INFO os_vif [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2')
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No VIF found with MAC fa:16:3e:f6:fb:4b, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updated VIF entry in instance network info cache for port b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-52868363-ac37-4b44-9cc8-0a078f59ae75 req-f942f17e-4dfd-4cb9-95b9-b0bace5a1608 service nova] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:02 user nova-compute[75463]: WARNING nova.compute.manager [req-3850f651-537b-4b52-a687-120ef6a8411e req-902a1317-67a2-4eb4-acb1-b048cca1a21d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state building and task_state spawning.
Nov 03 17:35:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:03 user nova-compute[75463]: INFO nova.compute.manager [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Terminating instance
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-unplugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] No waiting events found dispatching network-vif-unplugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-26bb29e4-2706-442d-89d2-7b691cd41d35 req-2f8101f8-64f3-42bc-b242-21f502989d9b service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-unplugged-a3f165a3-cf11-45d9-9c86-01f5754981ce for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:35:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Instance destroyed successfully.
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lazy-loading 'resources' on Instance uuid aa42692c-c217-41b8-a584-c9b33686c643 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1973708316',display_name='tempest-TestVolumeSwap-server-1973708316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1973708316',id=10,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNo2+wzrAe/qFGDUuT5T6035CoOmGI/aUQfthaqh5nwzO4s+OlNphH1kxXWkkEOhcKea6wYh4AJooej0pZofnwuTDkX4Oc0fRCdd1JFte4Q/a0Lwe9J8kjSqjXqWobzqRA==',key_name='tempest-keypair-1663736946',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ba6f421521a46c5b14a85c3cb3888d8',ramdisk_id='',reservation_id='r-k7rsi06l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1132161682',owner_user_name='tempest-TestVolumeSwap-1132161682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c42ca6cbfbb4065b768b8dab3539c97',uuid=aa42692c-c217-41b8-a584-c9b33686c643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converting VIF {"id": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "address": "fa:16:3e:79:ba:68", "network": {"id": "d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-299487247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ba6f421521a46c5b14a85c3cb3888d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f165a3-cf", "ovs_interfaceid": "a3f165a3-cf11-45d9-9c86-01f5754981ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG os_vif [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f165a3-cf, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a565c45-aeba-43d6-af91-03016f696985) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:03 user nova-compute[75463]: INFO os_vif [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:ba:68,bridge_name='br-int',has_traffic_filtering=True,id=a3f165a3-cf11-45d9-9c86-01f5754981ce,network=Network(d3f7c60e-2fd6-4d2a-a85f-25bb0071e98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f165a3-cf')
Nov 03 17:35:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Deleting instance files /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643_del
Nov 03 17:35:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Deletion of /opt/stack/data/nova/instances/aa42692c-c217-41b8-a584-c9b33686c643_del complete
Nov 03 17:35:04 user nova-compute[75463]: INFO nova.compute.manager [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 03 17:35:04 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:35:04 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance spawned successfully.
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:04 user nova-compute[75463]: WARNING nova.compute.manager [req-79db2f45-5412-4c6e-b078-900b53f020b5 req-ad8278f3-f8f3-48c4-af85-fb859e128433 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state building and task_state spawning.
Nov 03 17:35:04 user nova-compute[75463]: INFO nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:35:04 user nova-compute[75463]: INFO nova.compute.manager [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Took 6.49 seconds to build instance.
Nov 03 17:35:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fbdd8d4-929a-46f7-9ebd-e47598f2068a tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.594s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:04 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:05 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Took 1.00 seconds to deallocate network for instance.
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] Acquiring lock "aa42692c-c217-41b8-a584-c9b33686c643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] Lock "aa42692c-c217-41b8-a584-c9b33686c643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] No waiting events found dispatching network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:05 user nova-compute[75463]: WARNING nova.compute.manager [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received unexpected event network-vif-plugged-a3f165a3-cf11-45d9-9c86-01f5754981ce for instance with vm_state deleted and task_state None.
Nov 03 17:35:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-a0426c9f-0d6d-4a7e-b932-a0b7bf9bcfb0 req-9f964115-f8a9-4e67-987d-60cd8ad184f9 service nova] [instance: aa42692c-c217-41b8-a584-c9b33686c643] Received event network-vif-deleted-a3f165a3-cf11-45d9-9c86-01f5754981ce {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:05 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Deleted allocations for instance aa42692c-c217-41b8-a584-c9b33686c643
Nov 03 17:35:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2334a1f7-b25d-4bff-b916-a71d4a3d48f4 tempest-TestVolumeSwap-1132161682 tempest-TestVolumeSwap-1132161682-project-member] Lock "aa42692c-c217-41b8-a584-c9b33686c643" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.565s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:18 user nova-compute[75463]: INFO nova.compute.manager [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Terminating instance
Nov 03 17:35:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-7402a225-ffe2-4e8d-b213-632ba7816d34 req-cd5e2010-1ae2-4e19-b3e5-215084b19208 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:35:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Instance destroyed successfully.
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lazy-loading 'resources' on Instance uuid 934190b6-f35a-4a1e-8e5e-3c76137f9f73 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1471355234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1841530318',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2WShKPf9wy0d/ovOtOEtRatC8RbHTPRUxUzs0OGBxRA379UNkVCr3gkaeDaD5ErJLAa2mdvXhnTdUpTlBnfEhxsCUoO5XrSVZ3HjePkarXl92omuooAedxg9v3A7wIg==',key_name='tempest-keypair-816713457',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='462cbd38529a42029b3f65c2db8425bb',ramdisk_id='',reservation_id='r-6tc3vqzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-322207706',owner_user_name='tempest-ServerActionsV293TestJSON-322207706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb8d92159473468e9a75ed0a90d9ec10',uuid=934190b6-f35a-4a1e-8e5e-3c76137f9f73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converting VIF {"id": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "address": "fa:16:3e:26:3e:53", "network": {"id": "1f55828a-0acf-47b8-b2d4-41ac1ed7985a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848455228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "462cbd38529a42029b3f65c2db8425bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b4e3c7e-d0", "ovs_interfaceid": "1b4e3c7e-d09d-492f-9615-eea70a3106f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_vif [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b4e3c7e-d0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=830f1d6c-38da-4541-bf34-e96759980d87) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:19 user nova-compute[75463]: INFO os_vif [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3e:53,bridge_name='br-int',has_traffic_filtering=True,id=1b4e3c7e-d09d-492f-9615-eea70a3106f6,network=Network(1f55828a-0acf-47b8-b2d4-41ac1ed7985a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b4e3c7e-d0')
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIvTnJZp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:35:19 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad5df9-af03-4a94-8083-eb8d9c070494]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:35:19 user nova-compute[75463]: No targets found.
Nov 03 17:35:19 user nova-compute[75463]: iSNS:
Nov 03 17:35:19 user nova-compute[75463]: No targets found.
Nov 03 17:35:19 user nova-compute[75463]: STATIC:
Nov 03 17:35:19 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850
Nov 03 17:35:19 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:35:19 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:35:19 user nova-compute[75463]: FIRMWARE:
Nov 03 17:35:19 user nova-compute[75463]: No targets found.
Nov 03 17:35:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:35:19 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:35:19 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54aecae-c138-4408-96af-1622cb494636]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c15f5b-6201-48a8-9b86-5ae499579704]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:35:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 (non-flash)
Nov 03 17:35:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec324160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850'): ({'sde'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Removing single pathed devices sde {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.057s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc5b00-2be6-4595-ab2d-d0cd2d04cba5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2975d-c790-46bd-8415-bf534f59353c]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Flushing IO for device /dev/sde {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314c1f2-f7ff-44ff-9876-3d369285a9ee]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b881c-ec00-45e3-b51c-79ff560b8589]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26232373363646434', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_82eb481d', '/dev/disk/by-id/scsi-1SCST_BIO82eb481d-b273cdd4a1ad7faf') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44a8ece-feb7-4ae8-825a-38c3cb77089b]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6b7a8-cf83-4f52-bcf4-17b2fb8d8d7e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[248915cd-565c-47e4-84f1-1712de46a999]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260]
Nov 03 17:35:19 user nova-compute[75463]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850, portal: 172.16.0.220,3260] successful.
Nov 03 17:35:19 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8552c3-a6cd-4a56-8643-c73eef62e850 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde7163c-7129-4af1-877d-d1b8ffe222b2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] <== disconnect_volume: return (403ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:35:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deleting instance files /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73_del
Nov 03 17:35:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deletion of /opt/stack/data/nova/instances/934190b6-f35a-4a1e-8e5e-3c76137f9f73_del complete
Nov 03 17:35:19 user nova-compute[75463]: INFO nova.compute.manager [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 03 17:35:19 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:35:19 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:20 user nova-compute[75463]: WARNING nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state deleting.
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:20 user nova-compute[75463]: WARNING nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state deleting.
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:20 user nova-compute[75463]: WARNING nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state deleting.
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-unplugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Acquiring lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] No waiting events found dispatching network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:20 user nova-compute[75463]: WARNING nova.compute.manager [req-058cf6b8-7324-47d5-891b-a8d34fa58e55 req-60ff40ba-7013-4fd1-88c7-024b070a321d service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received unexpected event network-vif-plugged-1b4e3c7e-d09d-492f-9615-eea70a3106f6 for instance with vm_state active and task_state deleting.
Nov 03 17:35:21 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:21 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Took 1.68 seconds to deallocate network for instance.
Nov 03 17:35:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-9d62eeaa-c850-4c8c-96f7-d201f88d395c req-ee4019b2-85ce-4995-a134-e76a26a75363 service nova] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Received event network-vif-deleted-1b4e3c7e-d09d-492f-9615-eea70a3106f6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:22 user nova-compute[75463]: INFO nova.compute.manager [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Took 0.97 seconds to detach 1 volumes for instance.
Nov 03 17:35:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] [instance: 934190b6-f35a-4a1e-8e5e-3c76137f9f73] Deleting volume: 5f8552c3-a6cd-4a56-8643-c73eef62e850 {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 17:35:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:23 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:23 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:23 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Deleted allocations for instance 934190b6-f35a-4a1e-8e5e-3c76137f9f73
Nov 03 17:35:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b0b7f055-2799-4e79-9449-d62c1ca76b50 tempest-ServerActionsV293TestJSON-322207706 tempest-ServerActionsV293TestJSON-322207706-project-member] Lock "934190b6-f35a-4a1e-8e5e-3c76137f9f73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.799s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:35:34 user nova-compute[75463]: INFO nova.compute.manager [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Unrescuing
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:35:34 user nova-compute[75463]: INFO nova.compute.claims [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Claim successful on node user
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'flavor' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:35:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.policy [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '439941527e584c22a684399b2b30a6d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310c11a9e2a4e17851e9f0367b6adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:35:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Creating image(s)
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "/opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "/opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance destroyed successfully.
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk 1073741824" returned: 0 in 0.050s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Successfully created port: 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Cannot resize image /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Ensure instance console log exists: /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:36 user nova-compute[75463]: INFO nova.compute.manager [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Terminating instance
Nov 03 17:35:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Successfully updated port: 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:37 user nova-compute[75463]: WARNING nova.compute.manager [req-0205493b-5d17-4561-8a2d-dfb76f8ed5d5 req-5d759f7f-de72-40d3-a4d4-39b91ab51077 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-unplugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] No waiting events found dispatching network-vif-unplugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-0109afe2-6842-4295-9bf1-fe6fd0011e7f req-98229775-15b5-4793-b17a-24423a07d0b2 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-unplugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Instance network_info: |[{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Start _get_guest_xml network_info=[{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:35:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745290583',display_name='tempest-ServerActionsTestOtherA-server-1745290583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745290583',id=18,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-v0bbys83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=0c5057dc-628c-4c02-bc41-27473e7bc516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.objects.instance [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:35:37 user nova-compute[75463]:   <uuid>0c5057dc-628c-4c02-bc41-27473e7bc516</uuid>
Nov 03 17:35:37 user nova-compute[75463]:   <name>instance-00000012</name>
Nov 03 17:35:37 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:35:37 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:35:37 user nova-compute[75463]:   <metadata>
Nov 03 17:35:37 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:35:37 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherA-server-1745290583</nova:name>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:35:37</nova:creationTime>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:35:37 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:35:37 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:owner>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:user uuid="439941527e584c22a684399b2b30a6d1">tempest-ServerActionsTestOtherA-1993044933-project-member</nova:user>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:project uuid="1310c11a9e2a4e17851e9f0367b6adc9">tempest-ServerActionsTestOtherA-1993044933</nova:project>
Nov 03 17:35:37 user nova-compute[75463]:       </nova:owner>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:35:37 user nova-compute[75463]:       <nova:ports>
Nov 03 17:35:37 user nova-compute[75463]:         <nova:port uuid="1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648">
Nov 03 17:35:37 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:35:37 user nova-compute[75463]:         </nova:port>
Nov 03 17:35:37 user nova-compute[75463]:       </nova:ports>
Nov 03 17:35:37 user nova-compute[75463]:     </nova:instance>
Nov 03 17:35:37 user nova-compute[75463]:   </metadata>
Nov 03 17:35:37 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:35:37 user nova-compute[75463]:     <system>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="serial">0c5057dc-628c-4c02-bc41-27473e7bc516</entry>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="uuid">0c5057dc-628c-4c02-bc41-27473e7bc516</entry>
Nov 03 17:35:37 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:35:37 user nova-compute[75463]:     </system>
Nov 03 17:35:37 user nova-compute[75463]:   </sysinfo>
Nov 03 17:35:37 user nova-compute[75463]:   <os>
Nov 03 17:35:37 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:35:37 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:35:37 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:35:37 user nova-compute[75463]:   </os>
Nov 03 17:35:37 user nova-compute[75463]:   <features>
Nov 03 17:35:37 user nova-compute[75463]:     <acpi/>
Nov 03 17:35:37 user nova-compute[75463]:     <apic/>
Nov 03 17:35:37 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:35:37 user nova-compute[75463]:   </features>
Nov 03 17:35:37 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:35:37 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:35:37 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:35:37 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:35:37 user nova-compute[75463]:   </clock>
Nov 03 17:35:37 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:35:37 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:35:37 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:35:37 user nova-compute[75463]:   </cpu>
Nov 03 17:35:37 user nova-compute[75463]:   <devices>
Nov 03 17:35:37 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:35:37 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:35:37 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk"/>
Nov 03 17:35:37 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:35:37 user nova-compute[75463]:     </disk>
Nov 03 17:35:37 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:35:37 user nova-compute[75463]:       <mac address="fa:16:3e:b1:ae:92"/>
Nov 03 17:35:37 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:35:37 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:35:37 user nova-compute[75463]:       <target dev="tap1fd0ec7b-2c"/>
Nov 03 17:35:37 user nova-compute[75463]:     </interface>
Nov 03 17:35:37 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:35:37 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/console.log" append="off"/>
Nov 03 17:35:37 user nova-compute[75463]:     </serial>
Nov 03 17:35:37 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:35:37 user nova-compute[75463]:     <video>
Nov 03 17:35:37 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:35:37 user nova-compute[75463]:     </video>
Nov 03 17:35:37 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:35:37 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:35:37 user nova-compute[75463]:     </rng>
Nov 03 17:35:37 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:35:37 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:35:37 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:35:37 user nova-compute[75463]:     </memballoon>
Nov 03 17:35:37 user nova-compute[75463]:   </devices>
Nov 03 17:35:37 user nova-compute[75463]: </domain>
Nov 03 17:35:37 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745290583',display_name='tempest-ServerActionsTestOtherA-server-1745290583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745290583',id=18,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-v0bbys83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=0c5057dc-628c-4c02-bc41-27473e7bc516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG os_vif [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffb100d5-b508-505a-b94b-62d884fb7b4b', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fd0ec7b-2c, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fd0ec7b-2c, col_values=(('qos', UUID('15fa0fcb-7d6a-41bd-a090-ef0a166c0f35')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fd0ec7b-2c, col_values=(('external_ids', {'iface-id': '1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:ae:92', 'vm-uuid': '0c5057dc-628c-4c02-bc41-27473e7bc516'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: INFO os_vif [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c')
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No VIF found with MAC fa:16:3e:b1:ae:92, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Instance destroyed successfully.
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'resources' on Instance uuid 7158723b-e605-4046-8352-d0cf7ee1e9ab {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1618144656',display_name='tempest-VolumesAdminNegativeTest-server-1618144656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1618144656',id=15,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-lfzfj7xw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:33:36Z,user_data=None,user_id='2991422c844b4064bb476827300e4119',uuid=7158723b-e605-4046-8352-d0cf7ee1e9ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "address": "fa:16:3e:a0:85:68", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c39e7-6f", "ovs_interfaceid": "a62c39e7-6f7e-4c55-9ce2-19ca352296f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG os_vif [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa62c39e7-6f, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cda9b1eb-32ff-4302-8c7c-5e6577cbd7c7) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: INFO os_vif [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:85:68,bridge_name='br-int',has_traffic_filtering=True,id=a62c39e7-6f7e-4c55-9ce2-19ca352296f5,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c39e7-6f')
Nov 03 17:35:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Deleting instance files /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab_del
Nov 03 17:35:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Deletion of /opt/stack/data/nova/instances/7158723b-e605-4046-8352-d0cf7ee1e9ab_del complete
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:38 user nova-compute[75463]: INFO nova.compute.manager [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 03 17:35:38 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:35:38 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:39 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Took 0.48 seconds to deallocate network for instance.
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing instance network info cache due to event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] Acquiring lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] No waiting events found dispatching network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:39 user nova-compute[75463]: WARNING nova.compute.manager [req-5de8cdbe-e3f9-439f-9afb-9e80663e162c req-22f1607b-3918-4265-812c-01058d368481 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received unexpected event network-vif-plugged-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 for instance with vm_state deleted and task_state None.
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Deleted allocations for instance 7158723b-e605-4046-8352-d0cf7ee1e9ab
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0904eaac-4671-4a8c-ae35-cdaba1ef96c7 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "7158723b-e605-4046-8352-d0cf7ee1e9ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated VIF entry in instance network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:39 user nova-compute[75463]: WARNING nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:39 user nova-compute[75463]: WARNING nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:39 user nova-compute[75463]: WARNING nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:35:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-86a5bd95-6ad8-49c7-b493-7c1cbb67844d req-af049629-f152-461a-b32f-392a0cad66c2 service nova] [instance: 7158723b-e605-4046-8352-d0cf7ee1e9ab] Received event network-vif-deleted-a62c39e7-6f7e-4c55-9ce2-19ca352296f5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] No waiting events found dispatching network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:41 user nova-compute[75463]: WARNING nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received unexpected event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 for instance with vm_state building and task_state spawning.
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] No waiting events found dispatching network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:35:41 user nova-compute[75463]: WARNING nova.compute.manager [req-32c22473-edd9-4dce-a98f-0ffd7301bb6e req-e98af9b4-e345-4779-bdc3-d4699f80925b service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received unexpected event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 for instance with vm_state building and task_state spawning.
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:35:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Instance spawned successfully.
Nov 03 17:35:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3b819a6f-c03f-4754-9fc5-eb32106f0dac tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:35:42 user nova-compute[75463]: INFO nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 03 17:35:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:35:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:42 user nova-compute[75463]: INFO nova.compute.manager [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Took 7.42 seconds to build instance.
Nov 03 17:35:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-79f40508-edfc-4791-8d8c-d5828dc253e1 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.533s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:46 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:35:46 user nova-compute[75463]: INFO nova.compute.claims [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Claim successful on node user
Nov 03 17:35:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:35:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:35:47 user nova-compute[75463]: DEBUG nova.policy [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5c6f094b0c423ea22b458b0beecb15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b9a3c05c7147b88d7814833b87d157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:35:47 user nova-compute[75463]: INFO nova.virt.block_device [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Booting with volume-backed-image cf8a3394-bcc6-4ef0-a69c-469776200bf6 at /dev/vda
Nov 03 17:35:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Successfully created port: 6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Successfully updated port: 6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-changed-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Refreshing instance network info cache due to event network-changed-6f252cf3-5926-40f0-835c-168ac8b0db4d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:35:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] Acquiring lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.network.neutron [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance network_info: |[{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] Acquired lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Refreshing network info cache for port 6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updated VIF entry in instance network info cache for port 6f252cf3-5926-40f0-835c-168ac8b0db4d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-da1e5e7b-c98e-441a-8503-978167040f81 req-50fe5a39-79d3-4195-879f-f1247422e973 service nova] Releasing lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Skipping network cache update for instance because it is Building. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 4bae3d43-2efe-474a-b57c-311b090b7ba1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:50 user nova-compute[75463]: WARNING nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 4bae3d43-2efe-474a-b57c-311b090b7ba1 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 8068fdfb-ac16-4213-8152-885a91e37616 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 263ef766-2fbd-4277-b464-2b654a5029ee {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "8068fdfb-ac16-4213-8152-885a91e37616" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "8068fdfb-ac16-4213-8152-885a91e37616" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:35:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.296546936035156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8068fdfb-ac16-4213-8152-885a91e37616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance fd24ad21-b275-4cf2-8a71-800c72c4b672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:35:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:35:59 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:35:59 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:35:59 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:35:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:36:06 user nova-compute[75463]: INFO nova.compute.claims [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Claim successful on node user
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:36:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.policy [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48c0e15fd4d84961960a5fb8a2582200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbe2dfdf2f345cc9be5ef5ee6fd8e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:36:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Creating image(s)
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk 1073741824" returned: 0 in 0.065s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Successfully created port: 9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Cannot resize image /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Ensure instance console log exists: /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Successfully updated port: 9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-changed-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Refreshing instance network info cache due to event network-changed-9caf690a-54b9-4d7e-a4fe-5f340846ee29. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:08 user nova-compute[75463]: INFO nova.compute.manager [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Terminating instance
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance network_info: |[{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Refreshing network info cache for port 9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start _get_guest_xml network_info=[{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:36:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'pci_devices' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:36:08 user nova-compute[75463]:   <uuid>16c9d9b1-e7e6-480c-9f80-682f2f928f19</uuid>
Nov 03 17:36:08 user nova-compute[75463]:   <name>instance-00000014</name>
Nov 03 17:36:08 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:36:08 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:36:08 user nova-compute[75463]:   <metadata>
Nov 03 17:36:08 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:36:08 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherB-server-510344882</nova:name>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:36:08</nova:creationTime>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:36:08 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:36:08 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:owner>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:user uuid="48c0e15fd4d84961960a5fb8a2582200">tempest-ServerActionsTestOtherB-82187790-project-member</nova:user>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:project uuid="4cbe2dfdf2f345cc9be5ef5ee6fd8e6a">tempest-ServerActionsTestOtherB-82187790</nova:project>
Nov 03 17:36:08 user nova-compute[75463]:       </nova:owner>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:36:08 user nova-compute[75463]:       <nova:ports>
Nov 03 17:36:08 user nova-compute[75463]:         <nova:port uuid="9caf690a-54b9-4d7e-a4fe-5f340846ee29">
Nov 03 17:36:08 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:36:08 user nova-compute[75463]:         </nova:port>
Nov 03 17:36:08 user nova-compute[75463]:       </nova:ports>
Nov 03 17:36:08 user nova-compute[75463]:     </nova:instance>
Nov 03 17:36:08 user nova-compute[75463]:   </metadata>
Nov 03 17:36:08 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:36:08 user nova-compute[75463]:     <system>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="serial">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="uuid">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:36:08 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:36:08 user nova-compute[75463]:     </system>
Nov 03 17:36:08 user nova-compute[75463]:   </sysinfo>
Nov 03 17:36:08 user nova-compute[75463]:   <os>
Nov 03 17:36:08 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:36:08 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:36:08 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:36:08 user nova-compute[75463]:   </os>
Nov 03 17:36:08 user nova-compute[75463]:   <features>
Nov 03 17:36:08 user nova-compute[75463]:     <acpi/>
Nov 03 17:36:08 user nova-compute[75463]:     <apic/>
Nov 03 17:36:08 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:36:08 user nova-compute[75463]:   </features>
Nov 03 17:36:08 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:36:08 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:36:08 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:36:08 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:36:08 user nova-compute[75463]:   </clock>
Nov 03 17:36:08 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:36:08 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:36:08 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:36:08 user nova-compute[75463]:   </cpu>
Nov 03 17:36:08 user nova-compute[75463]:   <devices>
Nov 03 17:36:08 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:36:08 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:36:08 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk"/>
Nov 03 17:36:08 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:36:08 user nova-compute[75463]:     </disk>
Nov 03 17:36:08 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:36:08 user nova-compute[75463]:       <mac address="fa:16:3e:1c:b3:b4"/>
Nov 03 17:36:08 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:36:08 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:36:08 user nova-compute[75463]:       <target dev="tap9caf690a-54"/>
Nov 03 17:36:08 user nova-compute[75463]:     </interface>
Nov 03 17:36:08 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:36:08 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/console.log" append="off"/>
Nov 03 17:36:08 user nova-compute[75463]:     </serial>
Nov 03 17:36:08 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:36:08 user nova-compute[75463]:     <video>
Nov 03 17:36:08 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:36:08 user nova-compute[75463]:     </video>
Nov 03 17:36:08 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:36:08 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:36:08 user nova-compute[75463]:     </rng>
Nov 03 17:36:08 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:36:08 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:36:08 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:36:08 user nova-compute[75463]:     </memballoon>
Nov 03 17:36:08 user nova-compute[75463]:   </devices>
Nov 03 17:36:08 user nova-compute[75463]: </domain>
Nov 03 17:36:08 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG os_vif [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dceeae0-b6eb-5ad6-a55c-5ecedc58987d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9caf690a-54, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9caf690a-54, col_values=(('qos', UUID('c0e690fa-6320-4f19-9e3a-d0d37807ab60')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9caf690a-54, col_values=(('external_ids', {'iface-id': '9caf690a-54b9-4d7e-a4fe-5f340846ee29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b3:b4', 'vm-uuid': '16c9d9b1-e7e6-480c-9f80-682f2f928f19'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: INFO os_vif [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No VIF found with MAC fa:16:3e:1c:b3:b4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d38158-d5e2-4718-a570-52777de28e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd0c6d-5a75-4cb8-808d-212ca3e68474]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updated VIF entry in instance network info cache for port 9caf690a-54b9-4d7e-a4fe-5f340846ee29. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8465a3f7-47f8-47c1-bdb8-ab9d6be2476f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c931be6-59c8-440e-bb94-31d3f78ce193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5c9e5bbb-0d36-42c0-8ae7-e6b989a5916e req-f314244a-d3b1-4178-945a-b076182b22eb service nova] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:36:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4fcf31-4c9a-4a64-82c3-33e102c3e74e]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating existing volume attachment record: b25fe05e-5620-48eb-90e3-e4b2e351c850 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:36:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Instance destroyed successfully.
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.objects.instance [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lazy-loading 'resources' on Instance uuid 8068fdfb-ac16-4213-8152-885a91e37616 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1811969193',display_name='tempest-ServerStableDeviceRescueTest-server-1811969193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1811969193',id=5,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzrDkYppvizaRQZYa8savARfG3q+k+RlWtGy+NNJEV2KPyY2k5xVFgsBGDN1rcAs43IKP0rapcNTPEABmdLmigsWADGRearvhdJGswCeaqsLIuJon9qZIbEQjyhxFb2pA==',key_name='tempest-keypair-1415038898',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08bff16abf848b9b2c427f79975327f',ramdisk_id='',reservation_id='r-n8eu45ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1512447065',owner_user_name='tempest-ServerStableDeviceRescueTest-1512447065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e751e1d904465b8437c94c71a9ab80',uuid=8068fdfb-ac16-4213-8152-885a91e37616,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converting VIF {"id": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "address": "fa:16:3e:bc:e2:16", "network": {"id": "d6f63c50-7700-4d23-989d-eb3553179697", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-826136884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08bff16abf848b9b2c427f79975327f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01cbe183-9b", "ovs_interfaceid": "01cbe183-9bb3-46fa-9c2a-e32d591c6c81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG os_vif [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01cbe183-9b, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb1ec27e-9915-4ee3-8131-94620ddf45a4) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: INFO os_vif [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e2:16,bridge_name='br-int',has_traffic_filtering=True,id=01cbe183-9bb3-46fa-9c2a-e32d591c6c81,network=Network(d6f63c50-7700-4d23-989d-eb3553179697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01cbe183-9b')
Nov 03 17:36:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Deleting instance files /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616_del
Nov 03 17:36:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Deletion of /opt/stack/data/nova/instances/8068fdfb-ac16-4213-8152-885a91e37616_del complete
Nov 03 17:36:09 user nova-compute[75463]: INFO nova.compute.manager [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 03 17:36:09 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-unplugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] No waiting events found dispatching network-vif-unplugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-unplugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Acquiring lock "8068fdfb-ac16-4213-8152-885a91e37616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] Lock "8068fdfb-ac16-4213-8152-885a91e37616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] No waiting events found dispatching network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:10 user nova-compute[75463]: WARNING nova.compute.manager [req-8e66fb1a-6caa-441d-b78a-c5cdfd4d8ed2 req-8d7b93a9-d49c-4080-b696-c1ffa6d79d10 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received unexpected event network-vif-plugged-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 for instance with vm_state active and task_state deleting.
Nov 03 17:36:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:10 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Took 1.07 seconds to deallocate network for instance.
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:10 user nova-compute[75463]: WARNING nova.compute.manager [req-e27444b5-ca62-4c35-bfc2-ec750711e23c req-2b7b72d5-cfeb-4417-82a0-37fe1a33162b service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state building and task_state spawning.
Nov 03 17:36:11 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:36:11 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:36:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:11 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Deleted allocations for instance 8068fdfb-ac16-4213-8152-885a91e37616
Nov 03 17:36:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-19a93c65-1dee-4113-bc82-ecd6ec8b5cb5 tempest-ServerStableDeviceRescueTest-1512447065 tempest-ServerStableDeviceRescueTest-1512447065-project-member] Lock "8068fdfb-ac16-4213-8152-885a91e37616" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-d25deb56-4f73-4ac2-a6ea-a310b92a433a req-c736bbda-ff7b-479c-8eae-2eb84f828129 service nova] [instance: 8068fdfb-ac16-4213-8152-885a91e37616] Received event network-vif-deleted-01cbe183-9bb3-46fa-9c2a-e32d591c6c81 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:12 user nova-compute[75463]: WARNING nova.compute.manager [req-4fdb6270-1867-4df5-a606-7b107a7083eb req-49507717-30e2-4366-b403-88246876e94a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state building and task_state spawning.
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:36:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance spawned successfully.
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:12 user nova-compute[75463]: INFO nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 03 17:36:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:36:13 user nova-compute[75463]: INFO nova.compute.manager [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Took 6.98 seconds to build instance.
Nov 03 17:36:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9d9ef05b-ede9-415b-9d1a-d06e00b00ae7 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.085s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:36:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:36:33 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Creating image(s)
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Ensure instance console log exists: /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start _get_guest_xml network_info=[{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a88be82d-522b-408e-a0a8-b707c0748d0e', 'attached_at': '', 'detached_at': '', 'volume_id': '4c887218-4695-4d86-8576-bf8a0ae84566', 'serial': '4c887218-4695-4d86-8576-bf8a0ae84566'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'b25fe05e-5620-48eb-90e3-e4b2e351c850', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:36:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:36:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:36:34 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:36:34 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:36:34 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46311b69-8a86-432d-94c7-1163d9aa2071]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:36:34 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9b791-66d9-4915-a5e8-9664540984fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566] added
Nov 03 17:36:34 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386bf98-4318-4da6-aaf6-761bbd371e4e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a13fc-6914-4adf-92a3-3429d0c774fe]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPWjDemJ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPWjDemJ" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[48358726-a22b-4cc8-84fe-4b7e5ef9c659]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPWjDemJ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75e18f-6066-493c-9c37-2343a7e995d8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4364e-4c2d-4e6a-9ae5-7b59758a1274]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:36:34 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:36:34 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:36:34 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:36:34 user nova-compute[75463]: 
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8169b45-c089-4af5-ada4-6e5d57f63b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260]
Nov 03 17:36:34 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260] successful.
Nov 03 17:36:34 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[548cda59-f844-4546-b78e-49b6c9829ded]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093dfe1-aa34-48bd-9d45-a83daa4345f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:36:34 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:36:34 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c10db9-4a22-45d5-957a-fc85c1371841]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:34 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23266346561616639', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266346561616639', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927141613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927141613',id=19,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-7uzamay3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:35:48Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=a88be82d-522b-408e-a0a8-b707c0748d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'pci_devices' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:36:35 user nova-compute[75463]:   <uuid>a88be82d-522b-408e-a0a8-b707c0748d0e</uuid>
Nov 03 17:36:35 user nova-compute[75463]:   <name>instance-00000013</name>
Nov 03 17:36:35 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:36:35 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:36:35 user nova-compute[75463]:   <metadata>
Nov 03 17:36:35 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:36:35 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1927141613</nova:name>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:36:33</nova:creationTime>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:36:35 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:36:35 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:owner>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:user uuid="bd5c6f094b0c423ea22b458b0beecb15">tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member</nova:user>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:project uuid="06b9a3c05c7147b88d7814833b87d157">tempest-ServerBootFromVolumeStableRescueTest-2042988048</nova:project>
Nov 03 17:36:35 user nova-compute[75463]:       </nova:owner>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:36:35 user nova-compute[75463]:       <nova:ports>
Nov 03 17:36:35 user nova-compute[75463]:         <nova:port uuid="6f252cf3-5926-40f0-835c-168ac8b0db4d">
Nov 03 17:36:35 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 17:36:35 user nova-compute[75463]:         </nova:port>
Nov 03 17:36:35 user nova-compute[75463]:       </nova:ports>
Nov 03 17:36:35 user nova-compute[75463]:     </nova:instance>
Nov 03 17:36:35 user nova-compute[75463]:   </metadata>
Nov 03 17:36:35 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:36:35 user nova-compute[75463]:     <system>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="serial">a88be82d-522b-408e-a0a8-b707c0748d0e</entry>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="uuid">a88be82d-522b-408e-a0a8-b707c0748d0e</entry>
Nov 03 17:36:35 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:36:35 user nova-compute[75463]:     </system>
Nov 03 17:36:35 user nova-compute[75463]:   </sysinfo>
Nov 03 17:36:35 user nova-compute[75463]:   <os>
Nov 03 17:36:35 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:36:35 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:36:35 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:36:35 user nova-compute[75463]:   </os>
Nov 03 17:36:35 user nova-compute[75463]:   <features>
Nov 03 17:36:35 user nova-compute[75463]:     <acpi/>
Nov 03 17:36:35 user nova-compute[75463]:     <apic/>
Nov 03 17:36:35 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:36:35 user nova-compute[75463]:   </features>
Nov 03 17:36:35 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:36:35 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:36:35 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:36:35 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:36:35 user nova-compute[75463]:   </clock>
Nov 03 17:36:35 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:36:35 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:36:35 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:36:35 user nova-compute[75463]:   </cpu>
Nov 03 17:36:35 user nova-compute[75463]:   <devices>
Nov 03 17:36:35 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:36:35 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:36:35 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:36:35 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:36:35 user nova-compute[75463]:       <serial>4c887218-4695-4d86-8576-bf8a0ae84566</serial>
Nov 03 17:36:35 user nova-compute[75463]:     </disk>
Nov 03 17:36:35 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:36:35 user nova-compute[75463]:       <mac address="fa:16:3e:c5:96:c4"/>
Nov 03 17:36:35 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:36:35 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:36:35 user nova-compute[75463]:       <target dev="tap6f252cf3-59"/>
Nov 03 17:36:35 user nova-compute[75463]:     </interface>
Nov 03 17:36:35 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:36:35 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/console.log" append="off"/>
Nov 03 17:36:35 user nova-compute[75463]:     </serial>
Nov 03 17:36:35 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:36:35 user nova-compute[75463]:     <video>
Nov 03 17:36:35 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:36:35 user nova-compute[75463]:     </video>
Nov 03 17:36:35 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:36:35 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:36:35 user nova-compute[75463]:     </rng>
Nov 03 17:36:35 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:36:35 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:36:35 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:36:35 user nova-compute[75463]:     </memballoon>
Nov 03 17:36:35 user nova-compute[75463]:   </devices>
Nov 03 17:36:35 user nova-compute[75463]: </domain>
Nov 03 17:36:35 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927141613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927141613',id=19,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-7uzamay3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:35:48Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=a88be82d-522b-408e-a0a8-b707c0748d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG os_vif [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3040c5a0-796a-5727-8fc5-3e0c97347cb8', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f252cf3-59, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f252cf3-59, col_values=(('qos', UUID('67b61da8-3427-4dd1-8839-e8ba65415608')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f252cf3-59, col_values=(('external_ids', {'iface-id': '6f252cf3-5926-40f0-835c-168ac8b0db4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:96:c4', 'vm-uuid': 'a88be82d-522b-408e-a0a8-b707c0748d0e'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:35 user nova-compute[75463]: INFO os_vif [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59')
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:36:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No VIF found with MAC fa:16:3e:c5:96:c4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:36:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-changed-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Refreshing instance network info cache due to event network-changed-b59a1813-92bb-4ed7-af26-edb6f244c21b. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:36:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] Acquiring lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:36:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] Acquired lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:36:36 user nova-compute[75463]: DEBUG nova.network.neutron [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Refreshing network info cache for port b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updated VIF entry in instance network info cache for port b59a1813-92bb-4ed7-af26-edb6f244c21b. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d465693c-940d-4a12-ba43-d0bd573691d8 req-f685c910-8011-49d6-8df7-256c46b9ed2a service nova] Releasing lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:37 user nova-compute[75463]: WARNING nova.compute.manager [req-ec7d9db0-e5d2-48fa-afca-15ad46c80b80 req-c486f728-d931-4d97-b329-e079073287df service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state building and task_state spawning.
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:36:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance spawned successfully.
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:39 user nova-compute[75463]: WARNING nova.compute.manager [req-9ef635ca-0597-4494-993a-67a494aaa312 req-7992e760-797e-41d4-a69b-c77bbbe02f8d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state building and task_state spawning.
Nov 03 17:36:39 user nova-compute[75463]: INFO nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:39 user nova-compute[75463]: INFO nova.compute.manager [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Terminating instance
Nov 03 17:36:39 user nova-compute[75463]: INFO nova.compute.manager [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Took 52.83 seconds to build instance.
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-649cdf89-6de8-4a4d-8986-a79d287de4fd tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.996s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 48.704s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:39 user nova-compute[75463]: INFO nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-unplugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] No waiting events found dispatching network-vif-unplugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-fd23060f-3683-462b-97ec-293c093ee3f7 req-72bde686-ab30-4e21-aa27-5d0780a02bc6 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-unplugged-b8a319c0-e940-4822-aee7-cb026cad6811 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Instance destroyed successfully.
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lazy-loading 'resources' on Instance uuid 8c04ed34-af8a-49b9-99ce-3bb48ef8584b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-474918975',display_name='tempest-VolumesAdminNegativeTest-server-474918975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-474918975',id=8,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM2TlN7BaLGgkjjDs+Sx1gXHBztlCLpMMgmDkIsma6BpbHiR1l2L86zc7OuWOGBLEXn7bNQfFsX3seflgA5zED8k8flLWnHBJwPTHyPmJOzqm2SFgU2cP4y45NX/tweuw==',key_name='tempest-keypair-1050106444',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51f4c5d074ef4609b31b26e88ed3bf1f',ramdisk_id='',reservation_id='r-e8hv6xtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1183184812',owner_user_name='tempest-VolumesAdminNegativeTest-1183184812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2991422c844b4064bb476827300e4119',uuid=8c04ed34-af8a-49b9-99ce-3bb48ef8584b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converting VIF {"id": "b8a319c0-e940-4822-aee7-cb026cad6811", "address": "fa:16:3e:26:40:17", "network": {"id": "a40ad4a7-0d5f-4e58-b988-1395af203f1f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2045071292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51f4c5d074ef4609b31b26e88ed3bf1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8a319c0-e9", "ovs_interfaceid": "b8a319c0-e940-4822-aee7-cb026cad6811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG os_vif [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8a319c0-e9, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26d37dfa-ed94-4a11-80d0-4b24ad5b4f4d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:40 user nova-compute[75463]: INFO os_vif [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:40:17,bridge_name='br-int',has_traffic_filtering=True,id=b8a319c0-e940-4822-aee7-cb026cad6811,network=Network(a40ad4a7-0d5f-4e58-b988-1395af203f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8a319c0-e9')
Nov 03 17:36:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Deleting instance files /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b_del
Nov 03 17:36:40 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Deletion of /opt/stack/data/nova/instances/8c04ed34-af8a-49b9-99ce-3bb48ef8584b_del complete
Nov 03 17:36:40 user nova-compute[75463]: INFO nova.compute.manager [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 17:36:40 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:36:40 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:36:41 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:41 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Took 1.16 seconds to deallocate network for instance.
Nov 03 17:36:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] Acquiring lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] No waiting events found dispatching network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:36:42 user nova-compute[75463]: WARNING nova.compute.manager [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received unexpected event network-vif-plugged-b8a319c0-e940-4822-aee7-cb026cad6811 for instance with vm_state deleted and task_state None.
Nov 03 17:36:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-0817e08c-efb3-48a1-a075-8024a2bc0e84 req-6fa2f1ec-86ef-4a16-875c-99f2757bf9f5 service nova] [instance: 8c04ed34-af8a-49b9-99ce-3bb48ef8584b] Received event network-vif-deleted-b8a319c0-e940-4822-aee7-cb026cad6811 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:36:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.873s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:42 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Deleted allocations for instance 8c04ed34-af8a-49b9-99ce-3bb48ef8584b
Nov 03 17:36:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5db4d172-df1a-4748-9fdc-e107ae112e48 tempest-VolumesAdminNegativeTest-1183184812 tempest-VolumesAdminNegativeTest-1183184812-project-member] Lock "8c04ed34-af8a-49b9-99ce-3bb48ef8584b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.212s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:43 user nova-compute[75463]: INFO nova.compute.manager [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Attaching volume 4fd40daf-8b75-4c1e-ba5d-d91d024be927 to /dev/vdb
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.utils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c778b29-a3a5-45ac-87c5-befda7708079]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d859f6-9254-4291-928e-c0c8d315e2bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[251614fc-51c9-4202-b36d-60f13b5ae6bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe01758-c35a-4495-b2e6-17872b7693c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:36:44 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:36:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[73abc07c-146b-4248-8fba-638702e13937]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG os_brick.utils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:36:44 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating existing volume attachment record: 6b361821-dd9a-4a80-873f-ca6b871bef22 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:36:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-changed-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing instance network info cache due to event network-changed-b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing network info cache for port b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updated VIF entry in instance network info cache for port b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG nova.network.neutron [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e1070e84-7551-499d-b79c-565526fce1fe req-60513b0c-947c-4c6d-b56d-193d9f3cbf43 service nova] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:36:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:36:51 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:36:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:36:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7520MB free_disk=25.32962417602539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance fd24ad21-b275-4cf2-8a71-800c72c4b672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:36:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:36:59 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:36:59 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:36:59 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:36:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:00 user nova-compute[75463]: INFO nova.compute.manager [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Shelving
Nov 03 17:37:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:01 user nova-compute[75463]: WARNING nova.compute.manager [req-b06825b8-3882-4a2b-a7ae-c58511d1fa50 req-2d8a215b-ad3e-440b-94dc-cda17b6e4d7c service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state active and task_state shelving.
Nov 03 17:37:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance destroyed successfully.
Nov 03 17:37:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Beginning cold snapshot process
Nov 03 17:37:02 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:37:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk /opt/stack/data/nova/instances/snapshots/tmprnu28dsh/4d33eb78bf0f4a17a4067b34e62fb760 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk /opt/stack/data/nova/instances/snapshots/tmprnu28dsh/4d33eb78bf0f4a17a4067b34e62fb760" returned: 0 in 0.824s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Snapshot extracted, beginning image upload
Nov 03 17:37:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:03 user nova-compute[75463]: WARNING nova.compute.manager [req-19bb81be-be38-41a3-a2e8-324da661fe47 req-89e4790f-1f78-4b3b-a5c0-6b5aab61d76b service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 17:37:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Snapshot image upload complete
Nov 03 17:37:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:37:06 user nova-compute[75463]: INFO nova.compute.manager [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Shelve offloading
Nov 03 17:37:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance destroyed successfully.
Nov 03 17:37:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:37:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:37:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance destroyed successfully.
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'resources' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEvK3WNl4mjZ5kmDZ3gCW61q5s0+za8AnwCv4gF2hOpefVCWrL0iZpfJIE8VYGFMwK4eZHCX36lFJT1FkV6pFyEjhYPnpyIqLommQkDwhaG09NARsAsOOFJNS1/eYLalw==',key_name='tempest-keypair-396563564',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:37:06.184005',shelved_host='user',shelved_image_id='df055a48-5ae2-4e42-a88a-4dc636c953ce'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_vif [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb698a98c-a2, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3500bd0e-d7b7-45cd-87f1-816c347eaacf) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:08 user nova-compute[75463]: INFO os_vif [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2')
Nov 03 17:37:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Deleting instance files /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672_del
Nov 03 17:37:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Deletion of /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672_del complete
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-changed-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing instance network info cache due to event network-changed-b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing network info cache for port b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:08 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Deleted allocations for instance fd24ad21-b275-4cf2-8a71-800c72c4b672
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXQsuWoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:37:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:37:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:37:08 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa78ef5-34e9-4386-9b42-6e9d56a66e35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:37:08 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bac130-4aea-4be9-b00f-d8c7c41153e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927] added
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'numa_topology' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.objects.base [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<fd24ad21-b275-4cf2-8a71-800c72c4b672> lazy-loaded attributes: resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcdef52-4724-44ce-9e43-a2623542d712]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b0296-14c0-41e1-84fb-fc9cb7fd713d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXQsuWoe {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXQsuWoe" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ca4b8f-7da3-4db6-9579-182fe75c4690]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXQsuWoe'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef71890f-1008-4b39-a1d7-e335e72fbd3b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d733035-42af-47eb-9df1-a724d1f8945d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aebaa5-1062-4abd-8995-1b83262f451c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260]
Nov 03 17:37:08 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260] successful.
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0202b8e-fa23-455b-b69b-fc5d24dadfec]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b3289-e211-4646-b58a-79ba610e0a17]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:37:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b120b8c6-d72a-4a99-b3ee-ca20b798b6e0]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXQsuWoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:37:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a0876443-578b-4621-85c0-7172a1ca1fff tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.271s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updated VIF entry in instance network info cache for port b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb698a98c-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61ac74be-324e-4609-a902-70303219bb99 req-211b03a0-4710-4653-994d-89b95f4fc0f3 service nova] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26531323130626433', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531323130626433', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:37:09 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:37:09 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:37:09 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:37:09 user nova-compute[75463]:   <serial>4fd40daf-8b75-4c1e-ba5d-d91d024be927</serial>
Nov 03 17:37:09 user nova-compute[75463]: </disk>
Nov 03 17:37:09 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:37:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:37:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:37:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:2a:da:e5, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:37:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c22a9049-7f33-4ead-9179-61ad9dfc5e03 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.908s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:15 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:37:15 user nova-compute[75463]: INFO nova.compute.claims [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Claim successful on node user
Nov 03 17:37:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:37:16 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.policy [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeadce7781c4ef7b888094b5707750a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27744d9d47034ad4bdc36f50bb525282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:37:16 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Creating image(s)
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk 1073741824" returned: 0 in 0.064s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Successfully created port: c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Cannot resize image /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Ensure instance console log exists: /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Successfully updated port: c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquired lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-changed-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Refreshing instance network info cache due to event network-changed-c253432d-f526-4116-8b8e-1bdf4cb01feb. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] Acquiring lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updating instance_info_cache with network_info: [{"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Releasing lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Instance network_info: |[{"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] Acquired lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Refreshing network info cache for port c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Start _get_guest_xml network_info=[{"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:37:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-576192382',display_name='tempest-AttachVolumeNegativeTest-server-576192382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-576192382',id=21,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY2TkyHqzAYxGPFD+rPqEtp2i7mKdqGrxzOU6cm6JzB9T3eOX88oY3Vn3IFPQtoauM2D7uDhyJthM326aZQtFH+OWfGIm8456wSj7Hm2SYiuQagcmLLEQX5HBJUXk1EJw==',key_name='tempest-keypair-1834199360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-m7voo6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=54c0176d-22e2-4449-a0f3-fcb279963be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c0176d-22e2-4449-a0f3-fcb279963be4 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:37:18 user nova-compute[75463]:   <uuid>54c0176d-22e2-4449-a0f3-fcb279963be4</uuid>
Nov 03 17:37:18 user nova-compute[75463]:   <name>instance-00000015</name>
Nov 03 17:37:18 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:37:18 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:37:18 user nova-compute[75463]:   <metadata>
Nov 03 17:37:18 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:37:18 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeNegativeTest-server-576192382</nova:name>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:37:18</nova:creationTime>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:37:18 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:37:18 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:owner>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:user uuid="7aeadce7781c4ef7b888094b5707750a">tempest-AttachVolumeNegativeTest-731383677-project-member</nova:user>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:project uuid="27744d9d47034ad4bdc36f50bb525282">tempest-AttachVolumeNegativeTest-731383677</nova:project>
Nov 03 17:37:18 user nova-compute[75463]:       </nova:owner>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:37:18 user nova-compute[75463]:       <nova:ports>
Nov 03 17:37:18 user nova-compute[75463]:         <nova:port uuid="c253432d-f526-4116-8b8e-1bdf4cb01feb">
Nov 03 17:37:18 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:37:18 user nova-compute[75463]:         </nova:port>
Nov 03 17:37:18 user nova-compute[75463]:       </nova:ports>
Nov 03 17:37:18 user nova-compute[75463]:     </nova:instance>
Nov 03 17:37:18 user nova-compute[75463]:   </metadata>
Nov 03 17:37:18 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:37:18 user nova-compute[75463]:     <system>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="serial">54c0176d-22e2-4449-a0f3-fcb279963be4</entry>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="uuid">54c0176d-22e2-4449-a0f3-fcb279963be4</entry>
Nov 03 17:37:18 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:37:18 user nova-compute[75463]:     </system>
Nov 03 17:37:18 user nova-compute[75463]:   </sysinfo>
Nov 03 17:37:18 user nova-compute[75463]:   <os>
Nov 03 17:37:18 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:37:18 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:37:18 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:37:18 user nova-compute[75463]:   </os>
Nov 03 17:37:18 user nova-compute[75463]:   <features>
Nov 03 17:37:18 user nova-compute[75463]:     <acpi/>
Nov 03 17:37:18 user nova-compute[75463]:     <apic/>
Nov 03 17:37:18 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:37:18 user nova-compute[75463]:   </features>
Nov 03 17:37:18 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:37:18 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:37:18 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:37:18 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:37:18 user nova-compute[75463]:   </clock>
Nov 03 17:37:18 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:37:18 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:37:18 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:37:18 user nova-compute[75463]:   </cpu>
Nov 03 17:37:18 user nova-compute[75463]:   <devices>
Nov 03 17:37:18 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:37:18 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:37:18 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk"/>
Nov 03 17:37:18 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:37:18 user nova-compute[75463]:     </disk>
Nov 03 17:37:18 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:37:18 user nova-compute[75463]:       <mac address="fa:16:3e:8c:3b:44"/>
Nov 03 17:37:18 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:18 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:37:18 user nova-compute[75463]:       <target dev="tapc253432d-f5"/>
Nov 03 17:37:18 user nova-compute[75463]:     </interface>
Nov 03 17:37:18 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:37:18 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/console.log" append="off"/>
Nov 03 17:37:18 user nova-compute[75463]:     </serial>
Nov 03 17:37:18 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:37:18 user nova-compute[75463]:     <video>
Nov 03 17:37:18 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:18 user nova-compute[75463]:     </video>
Nov 03 17:37:18 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:37:18 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:37:18 user nova-compute[75463]:     </rng>
Nov 03 17:37:18 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:37:18 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:37:18 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:37:18 user nova-compute[75463]:     </memballoon>
Nov 03 17:37:18 user nova-compute[75463]:   </devices>
Nov 03 17:37:18 user nova-compute[75463]: </domain>
Nov 03 17:37:18 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-576192382',display_name='tempest-AttachVolumeNegativeTest-server-576192382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-576192382',id=21,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY2TkyHqzAYxGPFD+rPqEtp2i7mKdqGrxzOU6cm6JzB9T3eOX88oY3Vn3IFPQtoauM2D7uDhyJthM326aZQtFH+OWfGIm8456wSj7Hm2SYiuQagcmLLEQX5HBJUXk1EJw==',key_name='tempest-keypair-1834199360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-m7voo6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=54c0176d-22e2-4449-a0f3-fcb279963be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG os_vif [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9aa5ff2b-6c5d-54dd-a33a-601c1e64f627', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc253432d-f5, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc253432d-f5, col_values=(('qos', UUID('f3e63c34-e334-4d03-a851-a4f71b72c86f')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc253432d-f5, col_values=(('external_ids', {'iface-id': 'c253432d-f526-4116-8b8e-1bdf4cb01feb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:3b:44', 'vm-uuid': '54c0176d-22e2-4449-a0f3-fcb279963be4'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:18 user nova-compute[75463]: INFO os_vif [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5')
Nov 03 17:37:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:8c:3b:44, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:37:19 user nova-compute[75463]: INFO nova.compute.claims [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Claim successful on node user
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.network.neutron [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updated VIF entry in instance network info cache for port c253432d-f526-4116-8b8e-1bdf4cb01feb. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.network.neutron [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updating instance_info_cache with network_info: [{"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7fe678c3-0d1c-4365-96c2-151b0f150b31 req-d49b6eed-260b-4454-9c28-80c961999027 service nova] Releasing lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:37:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.policy [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b708d9b46f3740d2be12b5479931444a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e08e396569dc4599a9f75a10796bb369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:37:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Creating image(s)
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "/opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "/opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.222s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk 1073741824" returned: 0 in 0.064s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Successfully created port: 970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.237s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Cannot resize image /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Ensure instance console log exists: /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] No waiting events found dispatching network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:21 user nova-compute[75463]: WARNING nova.compute.manager [req-dfc55616-a6f6-4148-b969-ccef44bb45d2 req-1f301a2a-d23d-473c-b982-fdcf6af5df2b service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received unexpected event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb for instance with vm_state building and task_state spawning.
Nov 03 17:37:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Successfully updated port: 970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquired lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.neutron [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Updating instance_info_cache with network_info: [{"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Releasing lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Instance network_info: |[{"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Start _get_guest_xml network_info=[{"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:37:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-303493848',display_name='tempest-VolumesActionsTest-instance-303493848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-303493848',id=22,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e08e396569dc4599a9f75a10796bb369',ramdisk_id='',reservation_id='r-lrfpefhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275156279',owner_user_name='tempest-VolumesActionsTest-1275156279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:20Z,user_data=None,user_id='b708d9b46f3740d2be12b5479931444a',uuid=3fc4ee32-7e97-4819-b3cd-8df85c66ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converting VIF {"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fc4ee32-7e97-4819-b3cd-8df85c66ab98 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:37:22 user nova-compute[75463]:   <uuid>3fc4ee32-7e97-4819-b3cd-8df85c66ab98</uuid>
Nov 03 17:37:22 user nova-compute[75463]:   <name>instance-00000016</name>
Nov 03 17:37:22 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:37:22 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:37:22 user nova-compute[75463]:   <metadata>
Nov 03 17:37:22 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:37:22 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:name>tempest-VolumesActionsTest-instance-303493848</nova:name>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:37:22</nova:creationTime>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:37:22 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:37:22 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:owner>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:user uuid="b708d9b46f3740d2be12b5479931444a">tempest-VolumesActionsTest-1275156279-project-member</nova:user>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:project uuid="e08e396569dc4599a9f75a10796bb369">tempest-VolumesActionsTest-1275156279</nova:project>
Nov 03 17:37:22 user nova-compute[75463]:       </nova:owner>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:37:22 user nova-compute[75463]:       <nova:ports>
Nov 03 17:37:22 user nova-compute[75463]:         <nova:port uuid="970305bb-ae78-47e0-af9a-2dc85f7d3c26">
Nov 03 17:37:22 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:37:22 user nova-compute[75463]:         </nova:port>
Nov 03 17:37:22 user nova-compute[75463]:       </nova:ports>
Nov 03 17:37:22 user nova-compute[75463]:     </nova:instance>
Nov 03 17:37:22 user nova-compute[75463]:   </metadata>
Nov 03 17:37:22 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:37:22 user nova-compute[75463]:     <system>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="serial">3fc4ee32-7e97-4819-b3cd-8df85c66ab98</entry>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="uuid">3fc4ee32-7e97-4819-b3cd-8df85c66ab98</entry>
Nov 03 17:37:22 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:37:22 user nova-compute[75463]:     </system>
Nov 03 17:37:22 user nova-compute[75463]:   </sysinfo>
Nov 03 17:37:22 user nova-compute[75463]:   <os>
Nov 03 17:37:22 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:37:22 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:37:22 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:37:22 user nova-compute[75463]:   </os>
Nov 03 17:37:22 user nova-compute[75463]:   <features>
Nov 03 17:37:22 user nova-compute[75463]:     <acpi/>
Nov 03 17:37:22 user nova-compute[75463]:     <apic/>
Nov 03 17:37:22 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:37:22 user nova-compute[75463]:   </features>
Nov 03 17:37:22 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:37:22 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:37:22 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:37:22 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:37:22 user nova-compute[75463]:   </clock>
Nov 03 17:37:22 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:37:22 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:37:22 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:37:22 user nova-compute[75463]:   </cpu>
Nov 03 17:37:22 user nova-compute[75463]:   <devices>
Nov 03 17:37:22 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:37:22 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:37:22 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk"/>
Nov 03 17:37:22 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:37:22 user nova-compute[75463]:     </disk>
Nov 03 17:37:22 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:37:22 user nova-compute[75463]:       <mac address="fa:16:3e:73:3d:1c"/>
Nov 03 17:37:22 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:22 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:37:22 user nova-compute[75463]:       <target dev="tap970305bb-ae"/>
Nov 03 17:37:22 user nova-compute[75463]:     </interface>
Nov 03 17:37:22 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:37:22 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/console.log" append="off"/>
Nov 03 17:37:22 user nova-compute[75463]:     </serial>
Nov 03 17:37:22 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:37:22 user nova-compute[75463]:     <video>
Nov 03 17:37:22 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:22 user nova-compute[75463]:     </video>
Nov 03 17:37:22 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:37:22 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:37:22 user nova-compute[75463]:     </rng>
Nov 03 17:37:22 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:37:22 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:37:22 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:37:22 user nova-compute[75463]:     </memballoon>
Nov 03 17:37:22 user nova-compute[75463]:   </devices>
Nov 03 17:37:22 user nova-compute[75463]: </domain>
Nov 03 17:37:22 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-303493848',display_name='tempest-VolumesActionsTest-instance-303493848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-303493848',id=22,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e08e396569dc4599a9f75a10796bb369',ramdisk_id='',reservation_id='r-lrfpefhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1275156279',owner_user_name='tempest-VolumesActionsTest-1275156279-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:20Z,user_data=None,user_id='b708d9b46f3740d2be12b5479931444a',uuid=3fc4ee32-7e97-4819-b3cd-8df85c66ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converting VIF {"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG os_vif [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c14295d6-e36a-5e6d-b3f9-1a3711783711', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap970305bb-ae, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap970305bb-ae, col_values=(('qos', UUID('2d3295f4-2fc4-4519-a35e-f201f7031c1e')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap970305bb-ae, col_values=(('external_ids', {'iface-id': '970305bb-ae78-47e0-af9a-2dc85f7d3c26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:3d:1c', 'vm-uuid': '3fc4ee32-7e97-4819-b3cd-8df85c66ab98'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:22 user nova-compute[75463]: INFO os_vif [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae')
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:37:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] No VIF found with MAC fa:16:3e:73:3d:1c, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:37:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Instance spawned successfully.
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:23 user nova-compute[75463]: INFO nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] No waiting events found dispatching network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:23 user nova-compute[75463]: WARNING nova.compute.manager [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received unexpected event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb for instance with vm_state building and task_state spawning.
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-changed-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Refreshing instance network info cache due to event network-changed-970305bb-ae78-47e0-af9a-2dc85f7d3c26. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Acquiring lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Acquired lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Refreshing network info cache for port 970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:23 user nova-compute[75463]: INFO nova.compute.manager [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Took 7.74 seconds to build instance.
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8e9fcda8-be0a-4fb5-a61d-b11cf56ad050 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.907s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Updated VIF entry in instance network info cache for port 970305bb-ae78-47e0-af9a-2dc85f7d3c26. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Updating instance_info_cache with network_info: [{"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0fdce6cd-5347-4dc3-800e-1941e1f53487 req-424a6a9e-670b-4387-810a-7fc2cb71792d service nova] Releasing lock "refresh_cache-3fc4ee32-7e97-4819-b3cd-8df85c66ab98" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] No waiting events found dispatching network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:24 user nova-compute[75463]: WARNING nova.compute.manager [req-7839bee1-33bd-49e4-99c8-7ff30c20b07a req-ecae015e-7f91-4064-b9df-8c9460caf76c service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received unexpected event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 for instance with vm_state building and task_state spawning.
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] No waiting events found dispatching network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:26 user nova-compute[75463]: WARNING nova.compute.manager [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received unexpected event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 for instance with vm_state building and task_state spawning.
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing instance network info cache due to event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:37:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Instance spawned successfully.
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:26 user nova-compute[75463]: INFO nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 03 17:37:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:37:27 user nova-compute[75463]: INFO nova.compute.manager [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Took 8.08 seconds to build instance.
Nov 03 17:37:27 user nova-compute[75463]: DEBUG nova.network.neutron [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated VIF entry in instance network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:27 user nova-compute[75463]: DEBUG nova.network.neutron [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b5de7aa-2108-4a6a-add9-870ac1656e6c tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.174s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-219b1e4d-aed5-465c-9e33-912aa2440933 req-5be9e503-2a8a-438c-af84-3ded35df2843 service nova] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:36 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:37:36 user nova-compute[75463]: INFO nova.compute.claims [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Claim successful on node user
Nov 03 17:37:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:37:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:37:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Creating image(s)
Nov 03 17:37:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:37 user nova-compute[75463]: DEBUG nova.policy [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a37cd705cb44c191fe6fad731b4873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e727b9484bb4bdeb41aff47171cb852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.222s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.244s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk 1073741824" returned: 0 in 0.070s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.253s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Cannot resize image /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Ensure instance console log exists: /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Successfully created port: 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Successfully updated port: 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing instance network info cache due to event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:39 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance network_info: |[{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.neutron [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start _get_guest_xml network_info=[{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:37:40 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:40 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-11196190',display_name='tempest-ServerRescueNegativeTestJSON-server-11196190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-11196190',id=23,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE73M3Ol7ADYyqS9FRTQwH0cZ7M/str/DVtrAgoXpl2KUqGATiIM0tygpgiTPdiIQpHC0u5uD1Qlb6Uyj1kiPxJXtW+glXUP7RSE6Cn5ECaHBOdGh7JVAMU7Z/SMEe7rcQ==',key_name='tempest-keypair-1281372959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-0p5lnn5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=6110a836-782f-4437-8970-dab2de7b0159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:37:40 user nova-compute[75463]:   <uuid>6110a836-782f-4437-8970-dab2de7b0159</uuid>
Nov 03 17:37:40 user nova-compute[75463]:   <name>instance-00000017</name>
Nov 03 17:37:40 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:37:40 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:37:40 user nova-compute[75463]:   <metadata>
Nov 03 17:37:40 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:37:40 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-11196190</nova:name>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:37:40</nova:creationTime>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:37:40 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:37:40 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:owner>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:37:40 user nova-compute[75463]:       </nova:owner>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:37:40 user nova-compute[75463]:       <nova:ports>
Nov 03 17:37:40 user nova-compute[75463]:         <nova:port uuid="86816a37-ae7e-4391-825d-88f2c37cd0ed">
Nov 03 17:37:40 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 17:37:40 user nova-compute[75463]:         </nova:port>
Nov 03 17:37:40 user nova-compute[75463]:       </nova:ports>
Nov 03 17:37:40 user nova-compute[75463]:     </nova:instance>
Nov 03 17:37:40 user nova-compute[75463]:   </metadata>
Nov 03 17:37:40 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:37:40 user nova-compute[75463]:     <system>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="serial">6110a836-782f-4437-8970-dab2de7b0159</entry>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="uuid">6110a836-782f-4437-8970-dab2de7b0159</entry>
Nov 03 17:37:40 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:37:40 user nova-compute[75463]:     </system>
Nov 03 17:37:40 user nova-compute[75463]:   </sysinfo>
Nov 03 17:37:40 user nova-compute[75463]:   <os>
Nov 03 17:37:40 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:37:40 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:37:40 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:37:40 user nova-compute[75463]:   </os>
Nov 03 17:37:40 user nova-compute[75463]:   <features>
Nov 03 17:37:40 user nova-compute[75463]:     <acpi/>
Nov 03 17:37:40 user nova-compute[75463]:     <apic/>
Nov 03 17:37:40 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:37:40 user nova-compute[75463]:   </features>
Nov 03 17:37:40 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:37:40 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:37:40 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:37:40 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:37:40 user nova-compute[75463]:   </clock>
Nov 03 17:37:40 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:37:40 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:37:40 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:37:40 user nova-compute[75463]:   </cpu>
Nov 03 17:37:40 user nova-compute[75463]:   <devices>
Nov 03 17:37:40 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:37:40 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:37:40 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk"/>
Nov 03 17:37:40 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:37:40 user nova-compute[75463]:     </disk>
Nov 03 17:37:40 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:37:40 user nova-compute[75463]:       <mac address="fa:16:3e:58:d3:fa"/>
Nov 03 17:37:40 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:40 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:37:40 user nova-compute[75463]:       <target dev="tap86816a37-ae"/>
Nov 03 17:37:40 user nova-compute[75463]:     </interface>
Nov 03 17:37:40 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:37:40 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/console.log" append="off"/>
Nov 03 17:37:40 user nova-compute[75463]:     </serial>
Nov 03 17:37:40 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:37:40 user nova-compute[75463]:     <video>
Nov 03 17:37:40 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:37:40 user nova-compute[75463]:     </video>
Nov 03 17:37:40 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:37:40 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:37:40 user nova-compute[75463]:     </rng>
Nov 03 17:37:40 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:37:40 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:37:40 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:37:40 user nova-compute[75463]:     </memballoon>
Nov 03 17:37:40 user nova-compute[75463]:   </devices>
Nov 03 17:37:40 user nova-compute[75463]: </domain>
Nov 03 17:37:40 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-11196190',display_name='tempest-ServerRescueNegativeTestJSON-server-11196190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-11196190',id=23,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE73M3Ol7ADYyqS9FRTQwH0cZ7M/str/DVtrAgoXpl2KUqGATiIM0tygpgiTPdiIQpHC0u5uD1Qlb6Uyj1kiPxJXtW+glXUP7RSE6Cn5ECaHBOdGh7JVAMU7Z/SMEe7rcQ==',key_name='tempest-keypair-1281372959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-0p5lnn5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=6110a836-782f-4437-8970-dab2de7b0159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG os_vif [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9c716f1-c51f-5101-998c-078fdaa92f3e', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86816a37-ae, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86816a37-ae, col_values=(('qos', UUID('cb35b76c-808f-4ff9-993c-90e42450ed8d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86816a37-ae, col_values=(('external_ids', {'iface-id': '86816a37-ae7e-4391-825d-88f2c37cd0ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:d3:fa', 'vm-uuid': '6110a836-782f-4437-8970-dab2de7b0159'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:40 user nova-compute[75463]: INFO os_vif [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae')
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:37:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:58:d3:fa, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:37:41 user nova-compute[75463]: DEBUG nova.network.neutron [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updated VIF entry in instance network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:41 user nova-compute[75463]: DEBUG nova.network.neutron [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e56853d3-e4d4-4541-bb26-b4c104d3db64 req-ab484e13-29d6-455d-b6f9-119f02d9d7b2 service nova] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:42 user nova-compute[75463]: WARNING nova.compute.manager [req-32faf722-b35e-4ea1-bf0a-1bf004fe2ab2 req-b3a196fe-92e7-4b36-ade6-7741a835ff82 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state building and task_state spawning.
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:37:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance spawned successfully.
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:37:44 user nova-compute[75463]: WARNING nova.compute.manager [req-49620b77-8c40-4f2d-8a3b-ff3b8d14eafa req-32236dc0-e7ef-4759-ac86-ad562f10e37c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state building and task_state spawning.
Nov 03 17:37:44 user nova-compute[75463]: INFO nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 03 17:37:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:37:44 user nova-compute[75463]: INFO nova.compute.manager [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Took 7.99 seconds to build instance.
Nov 03 17:37:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7d0faab4-cde9-4e5d-8bed-ccc7b8c4619c tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.165s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:51 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:37:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:37:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:37:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:37:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-changed-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Refreshing instance network info cache due to event network-changed-9caf690a-54b9-4d7e-a4fe-5f340846ee29. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Refreshing network info cache for port 9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:37:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updated VIF entry in instance network info cache for port 9caf690a-54b9-4d7e-a4fe-5f340846ee29. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ef2f220e-9f74-4d52-81b3-bcbc856d4dda req-891ea03e-6a84-4892-8405-f6c231a8e5ed service nova] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:37:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:01 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:38:01 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7334MB free_disk=25.22018051147461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 54c0176d-22e2-4449-a0f3-fcb279963be4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3fc4ee32-7e97-4819-b3cd-8df85c66ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:38:01 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:38:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:38:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:27 user nova-compute[75463]: INFO nova.compute.manager [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Rescuing
Nov 03 17:38:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:38:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:38:29 user nova-compute[75463]: WARNING nova.compute.manager [req-af89b669-0818-4b4b-9356-5fd2cf90de90 req-02865e8a-f3a5-49a1-b9ec-01d900a2e63d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state active and task_state rescuing.
Nov 03 17:38:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance destroyed successfully.
Nov 03 17:38:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Attempting a stable device rescue
Nov 03 17:38:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75463) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 17:38:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Creating image(s)
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'trusted_certs' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.part --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG nova.virt.images [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] c0de3d87-54e7-4bcc-8a44-c30242971382 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:38:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.part /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:38:31 user nova-compute[75463]: WARNING nova.compute.manager [req-4ebc39c0-e8c8-4593-8603-82b74bd40416 req-64573792-3e9b-48d1-ac33-9c7710354e4b service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state active and task_state rescuing.
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.part /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.converted" returned: 0 in 0.282s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.851s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b,backing_fmt=raw /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b,backing_fmt=raw /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue" returned: 0 in 0.073s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "eaefb58950912fcb2c9764088ae3967db2c2d78b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'migration_context' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Object Instance<a88be82d-522b-408e-a0a8-b707c0748d0e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start _get_guest_xml network_info=[{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "vif_mac": "fa:16:3e:c5:96:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c0de3d87-54e7-4bcc-8a44-c30242971382', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a88be82d-522b-408e-a0a8-b707c0748d0e', 'attached_at': '', 'detached_at': '', 'volume_id': '4c887218-4695-4d86-8576-bf8a0ae84566', 'serial': '4c887218-4695-4d86-8576-bf8a0ae84566'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'b25fe05e-5620-48eb-90e3-e4b2e351c850', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'resources' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Object Instance<a88be82d-522b-408e-a0a8-b707c0748d0e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'numa_topology' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Object Instance<a88be82d-522b-408e-a0a8-b707c0748d0e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:38:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:38:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'vcpu_model' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Object Instance<a88be82d-522b-408e-a0a8-b707c0748d0e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:38:31 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:38:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:38:31 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:38:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:38:31 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af399b-d9b9-4946-846b-af667518a070]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xPWjDemJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 03 17:38:32 user nova-compute[75463]: node.name = iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:38:32 user nova-compute[75463]: node.tpgt = -1
Nov 03 17:38:32 user nova-compute[75463]: node.startup = automatic
Nov 03 17:38:32 user nova-compute[75463]: node.leading_login = No
Nov 03 17:38:32 user nova-compute[75463]: iface.iscsi_ifacename = default
Nov 03 17:38:32 user nova-compute[75463]: iface.net_ifacename = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.ipaddress = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.prefix_len = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.hwaddress = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.transport_name = tcp
Nov 03 17:38:32 user nova-compute[75463]: iface.initiatorname = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.vlan_id = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.vlan_priority = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.vlan_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.iface_num = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.mtu = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.port = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.bootproto = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.subnet_mask = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.gateway = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_alt_client_id_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_alt_client_id = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_dns = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_learn_iqn = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_req_vendor_id_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_vendor_id_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_vendor_id = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.dhcp_slp_da = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.fragmentation = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.gratuitous_arp = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.incoming_forwarding = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.tos_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.tos = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.ttl = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.delayed_ack = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.tcp_nagle = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.tcp_wsf_state = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.tcp_wsf = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.tcp_timer_scale = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.tcp_timestamp = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.redirect = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.def_task_mgmt_timeout = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.header_digest = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.data_digest = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.immediate_data = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.initial_r2t = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.data_seq_inorder = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.data_pdu_inorder = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.erl = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.max_receive_data_len = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.first_burst_len = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.max_outstanding_r2t = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.max_burst_len = 0
Nov 03 17:38:32 user nova-compute[75463]: iface.chap_auth = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.bidi_chap = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.strict_login_compliance = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.discovery_auth = <empty>
Nov 03 17:38:32 user nova-compute[75463]: iface.discovery_logout = <empty>
Nov 03 17:38:32 user nova-compute[75463]: node.discovery_address = <empty>
Nov 03 17:38:32 user nova-compute[75463]: node.discovery_port = 0
Nov 03 17:38:32 user nova-compute[75463]: node.discovery_type = static
Nov 03 17:38:32 user nova-compute[75463]: node.session.initial_cmdsn = 0
Nov 03 17:38:32 user nova-compute[75463]: node.session.initial_login_retry_max = 8
Nov 03 17:38:32 user nova-compute[75463]: node.session.xmit_thread_priority = -20
Nov 03 17:38:32 user nova-compute[75463]: node.session.cmds_max = 128
Nov 03 17:38:32 user nova-compute[75463]: node.session.queue_depth = 32
Nov 03 17:38:32 user nova-compute[75463]: node.session.nr_sessions = 1
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.authmethod = CHAP
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.username = xPWjDemJ
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.password = ***
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.username_in = <empty>
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.password_in = <empty>
Nov 03 17:38:32 user nova-compute[75463]: node.session.auth.chap_algs = MD5
Nov 03 17:38:32 user nova-compute[75463]: node.session.timeo.replacement_timeout = 120
Nov 03 17:38:32 user nova-compute[75463]: node.session.err_timeo.abort_timeout = 15
Nov 03 17:38:32 user nova-compute[75463]: node.session.err_timeo.lu_reset_timeout = 30
Nov 03 17:38:32 user nova-compute[75463]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 03 17:38:32 user nova-compute[75463]: node.session.err_timeo.host_reset_timeout = 60
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.FastAbort = Yes
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.InitialR2T = No
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.ImmediateData = Yes
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.FirstBurstLength = 262144
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.MaxBurstLength = 16776192
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.DefaultTime2Retain = 0
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.DefaultTime2Wait = 2
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.MaxConnections = 1
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 03 17:38:32 user nova-compute[75463]: node.session.iscsi.ERL = 0
Nov 03 17:38:32 user nova-compute[75463]: node.session.scan = manual
Nov 03 17:38:32 user nova-compute[75463]: node.session.reopen_max = 0
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].address = 172.16.0.220
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].port = 3260
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].startup = manual
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].tcp.window_size = 524288
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].tcp.type_of_service = 0
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].timeo.logout_timeout = 15
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].timeo.login_timeout = 15
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].timeo.auth_timeout = 45
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].timeo.noop_out_interval = 5
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].timeo.noop_out_timeout = 5
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.HeaderDigest = None
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.DataDigest = None
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.IFMarker = No
Nov 03 17:38:32 user nova-compute[75463]: node.conn[0].iscsi.OFMarker = No
Nov 03 17:38:32 user nova-compute[75463]: # END RECORD
Nov 03 17:38:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b7fbd-34db-43bc-9892-abcb74a8dd00]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca8059-8ce7-4b27-9f28-378fe180a5c7]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPWjDemJ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPWjDemJ" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0986d149-6e5b-45ed-b0e9-1e3ad5ff8225]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPWjDemJ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a752cbd-af4d-4423-a7e1-219692f448cc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94277e9c-b973-470d-857d-bc1b9112113e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:38:32 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:38:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:38:32 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:38:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[00926d17-8877-4031-b13f-106da30a64a8]: (4, ('0 0 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] <== connect_volume: return (210ms) {'type': 'block', 'scsi_wwn': '23266346561616639', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266346561616639', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927141613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927141613',id=19,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:36:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-7uzamay3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:36:39Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=a88be82d-522b-408e-a0a8-b707c0748d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "vif_mac": "fa:16:3e:c5:96:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "vif_mac": "fa:16:3e:c5:96:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.objects.instance [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'pci_devices' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.objects.base [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Object Instance<a88be82d-522b-408e-a0a8-b707c0748d0e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:38:32 user nova-compute[75463]:   <uuid>a88be82d-522b-408e-a0a8-b707c0748d0e</uuid>
Nov 03 17:38:32 user nova-compute[75463]:   <name>instance-00000013</name>
Nov 03 17:38:32 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:38:32 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:38:32 user nova-compute[75463]:   <metadata>
Nov 03 17:38:32 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:38:32 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1927141613</nova:name>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:38:31</nova:creationTime>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:38:32 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:38:32 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:owner>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:user uuid="bd5c6f094b0c423ea22b458b0beecb15">tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member</nova:user>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:project uuid="06b9a3c05c7147b88d7814833b87d157">tempest-ServerBootFromVolumeStableRescueTest-2042988048</nova:project>
Nov 03 17:38:32 user nova-compute[75463]:       </nova:owner>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:38:32 user nova-compute[75463]:       <nova:ports>
Nov 03 17:38:32 user nova-compute[75463]:         <nova:port uuid="6f252cf3-5926-40f0-835c-168ac8b0db4d">
Nov 03 17:38:32 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 17:38:32 user nova-compute[75463]:         </nova:port>
Nov 03 17:38:32 user nova-compute[75463]:       </nova:ports>
Nov 03 17:38:32 user nova-compute[75463]:     </nova:instance>
Nov 03 17:38:32 user nova-compute[75463]:   </metadata>
Nov 03 17:38:32 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:38:32 user nova-compute[75463]:     <system>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="serial">a88be82d-522b-408e-a0a8-b707c0748d0e</entry>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="uuid">a88be82d-522b-408e-a0a8-b707c0748d0e</entry>
Nov 03 17:38:32 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:38:32 user nova-compute[75463]:     </system>
Nov 03 17:38:32 user nova-compute[75463]:   </sysinfo>
Nov 03 17:38:32 user nova-compute[75463]:   <os>
Nov 03 17:38:32 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:38:32 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:38:32 user nova-compute[75463]:   </os>
Nov 03 17:38:32 user nova-compute[75463]:   <features>
Nov 03 17:38:32 user nova-compute[75463]:     <acpi/>
Nov 03 17:38:32 user nova-compute[75463]:     <apic/>
Nov 03 17:38:32 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:38:32 user nova-compute[75463]:   </features>
Nov 03 17:38:32 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:38:32 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:38:32 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:38:32 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:38:32 user nova-compute[75463]:   </clock>
Nov 03 17:38:32 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:38:32 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:38:32 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:38:32 user nova-compute[75463]:   </cpu>
Nov 03 17:38:32 user nova-compute[75463]:   <devices>
Nov 03 17:38:32 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:38:32 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:38:32 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:38:32 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:38:32 user nova-compute[75463]:       <serial>4c887218-4695-4d86-8576-bf8a0ae84566</serial>
Nov 03 17:38:32 user nova-compute[75463]:     </disk>
Nov 03 17:38:32 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:38:32 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:38:32 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue"/>
Nov 03 17:38:32 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:38:32 user nova-compute[75463]:       <boot order="1"/>
Nov 03 17:38:32 user nova-compute[75463]:     </disk>
Nov 03 17:38:32 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:38:32 user nova-compute[75463]:       <mac address="fa:16:3e:c5:96:c4"/>
Nov 03 17:38:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:38:32 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:38:32 user nova-compute[75463]:       <target dev="tap6f252cf3-59"/>
Nov 03 17:38:32 user nova-compute[75463]:     </interface>
Nov 03 17:38:32 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:38:32 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/console.log" append="off"/>
Nov 03 17:38:32 user nova-compute[75463]:     </serial>
Nov 03 17:38:32 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:38:32 user nova-compute[75463]:     <video>
Nov 03 17:38:32 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:38:32 user nova-compute[75463]:     </video>
Nov 03 17:38:32 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:38:32 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:38:32 user nova-compute[75463]:     </rng>
Nov 03 17:38:32 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:38:32 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:38:32 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:38:32 user nova-compute[75463]:     </memballoon>
Nov 03 17:38:32 user nova-compute[75463]:   </devices>
Nov 03 17:38:32 user nova-compute[75463]: </domain>
Nov 03 17:38:32 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:38:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance destroyed successfully.
Nov 03 17:38:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:38:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] No VIF found with MAC fa:16:3e:c5:96:c4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:38:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:38:34 user nova-compute[75463]: WARNING nova.compute.manager [req-6d051011-370a-4419-b73e-94265f94c4b1 req-8305ebf8-c23f-4620-bab1-5797a2953f8a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state active and task_state rescuing.
Nov 03 17:38:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:38:36 user nova-compute[75463]: WARNING nova.compute.manager [req-504d655c-9101-46a6-ad78-f535bbf8ed4f req-de39ff98-1ba7-4a31-8e39-5610e5ce429d service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state active and task_state rescuing.
Nov 03 17:38:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-16b46441-f437-4ecd-b407-2194750d6e63 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:38:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:38:44 user nova-compute[75463]: INFO nova.compute.claims [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Claim successful on node user
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:38:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:38:45 user nova-compute[75463]: INFO nova.virt.block_device [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Booting with volume snapshot 1d183416-b7a2-4975-a36f-0b0559ccf588 at /dev/vda
Nov 03 17:38:45 user nova-compute[75463]: DEBUG nova.policy [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:38:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:46 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Successfully created port: a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Successfully updated port: a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-changed-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Refreshing instance network info cache due to event network-changed-a176cc71-9e90-4ec9-baee-94adb7c02e70. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] Acquiring lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Updating instance_info_cache with network_info: [{"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Instance network_info: |[{"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] Acquired lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Refreshing network info cache for port a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Updated VIF entry in instance network info cache for port a176cc71-9e90-4ec9-baee-94adb7c02e70. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:38:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Updating instance_info_cache with network_info: [{"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca91e1e7-5a54-4837-a987-8703e398ac6d req-6475062d-cc9a-43cf-aee9-6e3c3bb25f33 service nova] Releasing lock "refresh_cache-a2e29a37-38cc-4d63-9718-e7c1d17dee9b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:50 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:38:50 user nova-compute[75463]: INFO nova.compute.claims [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Claim successful on node user
Nov 03 17:38:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.utils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6834059-e78a-430f-a591-6553a249c4ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571e40c-cb58-4860-8d9d-6f0c56b75f56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2a954-bd35-44e0-b612-63c5638f6f38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94eaa9-1b39-4896-8b3f-c2d2eb5fd597]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:51 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8144ee1-8ff6-4e5d-af20-509309d553cb]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.utils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Updating existing volume attachment record: 4ecf6ba4-ff47-42f6-8208-426c5fead525 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:38:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:38:51 user nova-compute[75463]: INFO nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Booting with volume a0bb0a0f-02fb-4599-93a4-d8c191305a50 at /dev/vda
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.policy [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '527aff6b1a0047fa8f5dec6271ed5f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40b758742d446419064852b47964eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce98b3e-2c93-4c9d-b21b-d63764f8545e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a272fa2-ae32-42b6-9824-53820c36e979]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b41177-d35d-486f-aab9-784ad8597046]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9b73d-0d8c-4571-b08f-1c0e80598dad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:51 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:38:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7011cff2-efd6-480a-b5e6-ee6192ab0bb4]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:38:51 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating existing volume attachment record: 17111e2d-f849-4751-8226-611cbb956104 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:38:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully created port: d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully created port: dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully created port: 2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:53 user nova-compute[75463]: INFO nova.compute.manager [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Unshelving
Nov 03 17:38:54 user nova-compute[75463]: INFO nova.virt.block_device [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Booting with volume 74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 at /dev/vdc
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully created port: 113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.utils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c0de5-1992-42cb-8d16-e025bc95e790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa36d9-acf8-43fa-a260-1730e1687aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aafa2f-5605-4399-b2b8-ac6a1292ff87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7cad9b-851d-4265-bf5c-d58cfbc4fbf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updating instance_info_cache with network_info: [{"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-263ef766-2fbd-4277-b464-2b654a5029ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:38:54 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e836fa62-7b05-4bef-8f08-e93257575790]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG os_brick.utils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating existing volume attachment record: dcb51480-3f2b-4c56-a5b3-11f7c6ac2c99 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:38:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully created port: f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.compute.manager [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.compute.manager [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-d3a879f7-3691-4255-a20a-8341c5421d9d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6cbed631-268e-4952-96eb-97236f9376be req-3b0cc2ee-86e1-4e55-9ac3-103c66a640eb service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-c25e8a44-091d-4a41-9549-63cbab062636. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-af47f12a-6e16-4fc7-86df-3ddd25b32533. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1b0aa547-09af-4295-a869-d3e8de195457 req-89f20a44-ace0-4258-a56b-a67d31f8c742 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: 2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: 113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-dd29b835-6c18-4f99-821b-4cdb2998daf6. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-2dced9bb-d511-4f9a-9241-c4a1e51982e5. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port 2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:38:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port 113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Successfully updated port: f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-28b37e9c-c981-4480-8d36-3fb37f53d139 req-7ca5a512-588c-4654-975b-558dc6803825 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-f5b692ca-3df7-48f3-ad72-49ab11a48d11. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.082061767578125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 54c0176d-22e2-4449-a0f3-fcb279963be4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 3fc4ee32-7e97-4819-b3cd-8df85c66ab98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a2e29a37-38cc-4d63-9718-e7c1d17dee9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance fd24ad21-b275-4cf2-8a71-800c72c4b672 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:39:02 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance network_info: |[{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updated VIF entry in instance network info cache for port f5b692ca-3df7-48f3-ad72-49ab11a48d11. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:39:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c01a143a-a521-4902-b355-4a594a2facb0 req-dcc9b77b-0502-4e88-a435-a85753cf5fd8 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-changed-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Refreshing instance network info cache due to event network-changed-c253432d-f526-4116-8b8e-1bdf4cb01feb. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] Acquiring lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] Acquired lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:06 user nova-compute[75463]: DEBUG nova.network.neutron [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Refreshing network info cache for port c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:07 user nova-compute[75463]: DEBUG nova.network.neutron [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updated VIF entry in instance network info cache for port c253432d-f526-4116-8b8e-1bdf4cb01feb. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:39:07 user nova-compute[75463]: DEBUG nova.network.neutron [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updating instance_info_cache with network_info: [{"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d65ae45d-bea2-47cb-9c5a-cae854d139f6 req-e736dde3-70b1-4b71-8522-0227366f2072 service nova] Releasing lock "refresh_cache-54c0176d-22e2-4449-a0f3-fcb279963be4" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:17 user nova-compute[75463]: INFO nova.compute.manager [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Terminating instance
Nov 03 17:39:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-unplugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] No waiting events found dispatching network-vif-unplugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-3252b2e0-0722-4bff-bed6-b20497aebff0 req-ac893e53-6dd9-467d-881d-2ca9715a6a54 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-unplugged-c253432d-f526-4116-8b8e-1bdf4cb01feb for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_requests' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'numa_topology' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.compute.claims [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Claim successful on node user
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Instance destroyed successfully.
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'resources' on Instance uuid 54c0176d-22e2-4449-a0f3-fcb279963be4 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-576192382',display_name='tempest-AttachVolumeNegativeTest-server-576192382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-576192382',id=21,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY2TkyHqzAYxGPFD+rPqEtp2i7mKdqGrxzOU6cm6JzB9T3eOX88oY3Vn3IFPQtoauM2D7uDhyJthM326aZQtFH+OWfGIm8456wSj7Hm2SYiuQagcmLLEQX5HBJUXk1EJw==',key_name='tempest-keypair-1834199360',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-m7voo6oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=54c0176d-22e2-4449-a0f3-fcb279963be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "address": "fa:16:3e:8c:3b:44", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc253432d-f5", "ovs_interfaceid": "c253432d-f526-4116-8b8e-1bdf4cb01feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG os_vif [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc253432d-f5, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3e63c34-e334-4d03-a851-a4f71b72c86f) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:18 user nova-compute[75463]: INFO os_vif [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:3b:44,bridge_name='br-int',has_traffic_filtering=True,id=c253432d-f526-4116-8b8e-1bdf4cb01feb,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc253432d-f5')
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Deleting instance files /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4_del
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Deletion of /opt/stack/data/nova/instances/54c0176d-22e2-4449-a0f3-fcb279963be4_del complete
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.compute.manager [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:39:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:18 user nova-compute[75463]: INFO nova.network.neutron [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating port b698a98c-a2d8-489b-acac-035363e3a121 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:19 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Took 1.11 seconds to deallocate network for instance.
Nov 03 17:39:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9da12ba-a7a1-4ef5-bf80-99642795acbe req-17af039d-e791-43a3-9480-2e5c26f56e3f service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-deleted-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Acquiring lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] No waiting events found dispatching network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:20 user nova-compute[75463]: WARNING nova.compute.manager [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: 54c0176d-22e2-4449-a0f3-fcb279963be4] Received unexpected event network-vif-plugged-c253432d-f526-4116-8b8e-1bdf4cb01feb for instance with vm_state deleted and task_state None.
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-changed-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing instance network info cache due to event network-changed-b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:20 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Deleted allocations for instance 54c0176d-22e2-4449-a0f3-fcb279963be4
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d4ceb856-b522-41d0-9033-968546d1e7f1 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "54c0176d-22e2-4449-a0f3-fcb279963be4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:39:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Creating image(s)
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.network.neutron [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Refreshing network info cache for port b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG nova.objects.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<fd24ad21-b275-4cf2-8a71-800c72c4b672> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.part --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.virt.images [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] df055a48-5ae2-4e42-a88a-4dc636c953ce was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.part /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updated VIF entry in instance network info cache for port b698a98c-a2d8-489b-acac-035363e3a121. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.part /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.converted" returned: 0 in 0.367s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff529151-77c2-4a2e-bdc8-065153003b6e req-6c52e306-377e-48b3-bfe4-62cd9636ac08 service nova] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.925s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:39:22 user nova-compute[75463]: INFO nova.compute.claims [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Claim successful on node user
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7,backing_fmt=raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7,backing_fmt=raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk 1073741824" returned: 0 in 0.061s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "db6fb85642bd6deec40cba28f4f4971de74f01e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 --force-share --output=json" returned: 0 in 0.213s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'migration_context' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.objects.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<fd24ad21-b275-4cf2-8a71-800c72c4b672> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:39:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Rebasing disk image.
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f -F raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.policy [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '439941527e584c22a684399b2b30a6d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310c11a9e2a4e17851e9f0367b6adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:39:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Creating image(s)
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "/opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "/opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "/opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk 1073741824" returned: 0 in 0.053s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Successfully created port: 04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Cannot resize image /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Ensure instance console log exists: /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Successfully updated port: 04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-changed-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Refreshing instance network info cache due to event network-changed-04ad84a4-3d23-48cf-8188-bbea03ad7bb2. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.neutron [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance network_info: |[{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Refreshing network info cache for port 04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Start _get_guest_xml network_info=[{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:39:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1090028409',display_name='tempest-tempest.common.compute-instance-1090028409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1090028409',id=26,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1AfZwh7k3+Aa+ekV9iFc4vdtYdcheXgNcrVDlBwPj/lX2qbd1MLGvloMtCPCTW2ydXVo9USSKtwP9n4iGmSyn4oQwVDl4e3b1qnqC8NlMqQ/jgmeNzZVPfa5EwHLNUhQ==',key_name='tempest-keypair-884601012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-k3ij7xgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=a851ebda-8d2a-492f-b1c3-55e17169f606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'pci_devices' on Instance uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:39:26 user nova-compute[75463]:   <uuid>a851ebda-8d2a-492f-b1c3-55e17169f606</uuid>
Nov 03 17:39:26 user nova-compute[75463]:   <name>instance-0000001a</name>
Nov 03 17:39:26 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:39:26 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:39:26 user nova-compute[75463]:   <metadata>
Nov 03 17:39:26 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:39:26 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:name>tempest-tempest.common.compute-instance-1090028409</nova:name>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:39:26</nova:creationTime>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:39:26 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:39:26 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:owner>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:user uuid="439941527e584c22a684399b2b30a6d1">tempest-ServerActionsTestOtherA-1993044933-project-member</nova:user>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:project uuid="1310c11a9e2a4e17851e9f0367b6adc9">tempest-ServerActionsTestOtherA-1993044933</nova:project>
Nov 03 17:39:26 user nova-compute[75463]:       </nova:owner>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:39:26 user nova-compute[75463]:       <nova:ports>
Nov 03 17:39:26 user nova-compute[75463]:         <nova:port uuid="04ad84a4-3d23-48cf-8188-bbea03ad7bb2">
Nov 03 17:39:26 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 17:39:26 user nova-compute[75463]:         </nova:port>
Nov 03 17:39:26 user nova-compute[75463]:       </nova:ports>
Nov 03 17:39:26 user nova-compute[75463]:     </nova:instance>
Nov 03 17:39:26 user nova-compute[75463]:   </metadata>
Nov 03 17:39:26 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:39:26 user nova-compute[75463]:     <system>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="serial">a851ebda-8d2a-492f-b1c3-55e17169f606</entry>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="uuid">a851ebda-8d2a-492f-b1c3-55e17169f606</entry>
Nov 03 17:39:26 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:39:26 user nova-compute[75463]:     </system>
Nov 03 17:39:26 user nova-compute[75463]:   </sysinfo>
Nov 03 17:39:26 user nova-compute[75463]:   <os>
Nov 03 17:39:26 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:39:26 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:39:26 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:39:26 user nova-compute[75463]:   </os>
Nov 03 17:39:26 user nova-compute[75463]:   <features>
Nov 03 17:39:26 user nova-compute[75463]:     <acpi/>
Nov 03 17:39:26 user nova-compute[75463]:     <apic/>
Nov 03 17:39:26 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:39:26 user nova-compute[75463]:   </features>
Nov 03 17:39:26 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:39:26 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:39:26 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:39:26 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:39:26 user nova-compute[75463]:   </clock>
Nov 03 17:39:26 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:39:26 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:39:26 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:39:26 user nova-compute[75463]:   </cpu>
Nov 03 17:39:26 user nova-compute[75463]:   <devices>
Nov 03 17:39:26 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:39:26 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:39:26 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk"/>
Nov 03 17:39:26 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:39:26 user nova-compute[75463]:     </disk>
Nov 03 17:39:26 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:39:26 user nova-compute[75463]:       <mac address="fa:16:3e:fe:ac:53"/>
Nov 03 17:39:26 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:26 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:39:26 user nova-compute[75463]:       <target dev="tap04ad84a4-3d"/>
Nov 03 17:39:26 user nova-compute[75463]:     </interface>
Nov 03 17:39:26 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:39:26 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/console.log" append="off"/>
Nov 03 17:39:26 user nova-compute[75463]:     </serial>
Nov 03 17:39:26 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:39:26 user nova-compute[75463]:     <video>
Nov 03 17:39:26 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:26 user nova-compute[75463]:     </video>
Nov 03 17:39:26 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:39:26 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:39:26 user nova-compute[75463]:     </rng>
Nov 03 17:39:26 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:39:26 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:39:26 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:39:26 user nova-compute[75463]:     </memballoon>
Nov 03 17:39:26 user nova-compute[75463]:   </devices>
Nov 03 17:39:26 user nova-compute[75463]: </domain>
Nov 03 17:39:26 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1090028409',display_name='tempest-tempest.common.compute-instance-1090028409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1090028409',id=26,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1AfZwh7k3+Aa+ekV9iFc4vdtYdcheXgNcrVDlBwPj/lX2qbd1MLGvloMtCPCTW2ydXVo9USSKtwP9n4iGmSyn4oQwVDl4e3b1qnqC8NlMqQ/jgmeNzZVPfa5EwHLNUhQ==',key_name='tempest-keypair-884601012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-k3ij7xgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=a851ebda-8d2a-492f-b1c3-55e17169f606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_vif [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cd28f37-cfc3-5d78-881b-280f5f516606', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ad84a4-3d, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04ad84a4-3d, col_values=(('qos', UUID('5659ff45-9e68-444e-b255-03463e15fbdb')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04ad84a4-3d, col_values=(('external_ids', {'iface-id': '04ad84a4-3d23-48cf-8188-bbea03ad7bb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ac:53', 'vm-uuid': 'a851ebda-8d2a-492f-b1c3-55e17169f606'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:26 user nova-compute[75463]: INFO os_vif [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d')
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No VIF found with MAC fa:16:3e:fe:ac:53, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f -F raw /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk" returned: 0 in 2.900s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Ensure instance console log exists: /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start _get_guest_xml network_info=[{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f1f32397bb3da8342160901bd1df7e7d',container_format='bare',created_at=2023-11-03T17:37:01Z,direct_url=<?>,disk_format='qcow2',id=df055a48-5ae2-4e42-a88a-4dc636c953ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-809221533-shelved',owner='a04e2c8b44f54272b2d9e693955fc4ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:37:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTePYKcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fd24ad21-b275-4cf2-8a71-800c72c4b672', 'attached_at': '', 'detached_at': '', 'volume_id': '74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 'serial': '74c00d7a-bbd3-495d-9ad0-5fb42171e7a6'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': 'dcb51480-3f2b-4c56-a5b3-11f7c6ac2c99', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:39:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f1f32397bb3da8342160901bd1df7e7d',container_format='bare',created_at=2023-11-03T17:37:01Z,direct_url=<?>,disk_format='qcow2',id=df055a48-5ae2-4e42-a88a-4dc636c953ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-809221533-shelved',owner='a04e2c8b44f54272b2d9e693955fc4ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:37:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.objects.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<fd24ad21-b275-4cf2-8a71-800c72c4b672> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTePYKcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:26 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cf08a8-c74b-459d-846b-094c502d5eb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:39:26 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a12389-d34a-416d-b60f-e6ba3010b12c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6] added
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e54fb-71ea-4b63-a529-9dd087a12470]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[876834c7-07cd-45e2-8b9b-6789cb1c1097]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTePYKcg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated VIF entry in instance network info cache for port 04ad84a4-3d23-48cf-8188-bbea03ad7bb2. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTePYKcg" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[49269fa7-f261-4d47-8c0a-9be0447cd15e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QTePYKcg'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2519f8cc-549c-438c-bd7c-cc4d2e5e5458 req-7dd0e6f6-2f56-4924-86e5-efd002c90877 service nova] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0265211-613f-4b4e-b33c-1784ef7bc2cf]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d674dc0-d52f-4cf3-a71f-9647e46d88df]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b18a8-19ed-42a8-bddf-9706c4059dfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260]
Nov 03 17:39:26 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260] successful.
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3958543d-e1fb-4c07-81fd-9771391e5135]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a6c24-d0cc-4354-bd54-0c50b29ca740]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fc68c-2e65-4823-a1c5-dd06f21d638a]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:39:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTePYKcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23562616231333766', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562616231333766', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='df055a48-5ae2-4e42-a88a-4dc636c953ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396563564',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:37:06.184005',shelved_host='user',shelved_image_id='df055a48-5ae2-4e42-a88a-4dc636c953ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_devices' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.objects.base [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<fd24ad21-b275-4cf2-8a71-800c72c4b672> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:39:28 user nova-compute[75463]:   <uuid>fd24ad21-b275-4cf2-8a71-800c72c4b672</uuid>
Nov 03 17:39:28 user nova-compute[75463]:   <name>instance-00000011</name>
Nov 03 17:39:28 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:39:28 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:39:28 user nova-compute[75463]:   <metadata>
Nov 03 17:39:28 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:39:28 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-809221533</nova:name>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:39:26</nova:creationTime>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:39:28 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:39:28 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:owner>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:user uuid="939dac096b51462687e049004fe3eb77">tempest-AttachVolumeShelveTestJSON-2020601692-project-member</nova:user>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:project uuid="a04e2c8b44f54272b2d9e693955fc4ae">tempest-AttachVolumeShelveTestJSON-2020601692</nova:project>
Nov 03 17:39:28 user nova-compute[75463]:       </nova:owner>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:root type="image" uuid="df055a48-5ae2-4e42-a88a-4dc636c953ce"/>
Nov 03 17:39:28 user nova-compute[75463]:       <nova:ports>
Nov 03 17:39:28 user nova-compute[75463]:         <nova:port uuid="b698a98c-a2d8-489b-acac-035363e3a121">
Nov 03 17:39:28 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:39:28 user nova-compute[75463]:         </nova:port>
Nov 03 17:39:28 user nova-compute[75463]:       </nova:ports>
Nov 03 17:39:28 user nova-compute[75463]:     </nova:instance>
Nov 03 17:39:28 user nova-compute[75463]:   </metadata>
Nov 03 17:39:28 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:39:28 user nova-compute[75463]:     <system>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="serial">fd24ad21-b275-4cf2-8a71-800c72c4b672</entry>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="uuid">fd24ad21-b275-4cf2-8a71-800c72c4b672</entry>
Nov 03 17:39:28 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:39:28 user nova-compute[75463]:     </system>
Nov 03 17:39:28 user nova-compute[75463]:   </sysinfo>
Nov 03 17:39:28 user nova-compute[75463]:   <os>
Nov 03 17:39:28 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:39:28 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:39:28 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:39:28 user nova-compute[75463]:   </os>
Nov 03 17:39:28 user nova-compute[75463]:   <features>
Nov 03 17:39:28 user nova-compute[75463]:     <acpi/>
Nov 03 17:39:28 user nova-compute[75463]:     <apic/>
Nov 03 17:39:28 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:39:28 user nova-compute[75463]:   </features>
Nov 03 17:39:28 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:39:28 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:39:28 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:39:28 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:39:28 user nova-compute[75463]:   </clock>
Nov 03 17:39:28 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:39:28 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:39:28 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:39:28 user nova-compute[75463]:   </cpu>
Nov 03 17:39:28 user nova-compute[75463]:   <devices>
Nov 03 17:39:28 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:39:28 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:39:28 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk"/>
Nov 03 17:39:28 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:39:28 user nova-compute[75463]:     </disk>
Nov 03 17:39:28 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:39:28 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:39:28 user nova-compute[75463]:       <source dev="/dev/sdd"/>
Nov 03 17:39:28 user nova-compute[75463]:       <target dev="vdc" bus="virtio"/>
Nov 03 17:39:28 user nova-compute[75463]:       <serial>74c00d7a-bbd3-495d-9ad0-5fb42171e7a6</serial>
Nov 03 17:39:28 user nova-compute[75463]:     </disk>
Nov 03 17:39:28 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:39:28 user nova-compute[75463]:       <mac address="fa:16:3e:f6:fb:4b"/>
Nov 03 17:39:28 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:28 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:39:28 user nova-compute[75463]:       <target dev="tapb698a98c-a2"/>
Nov 03 17:39:28 user nova-compute[75463]:     </interface>
Nov 03 17:39:28 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:39:28 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/console.log" append="off"/>
Nov 03 17:39:28 user nova-compute[75463]:     </serial>
Nov 03 17:39:28 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:39:28 user nova-compute[75463]:     <video>
Nov 03 17:39:28 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:28 user nova-compute[75463]:     </video>
Nov 03 17:39:28 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:39:28 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:39:28 user nova-compute[75463]:     </rng>
Nov 03 17:39:28 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:39:28 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:39:28 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:39:28 user nova-compute[75463]:     </memballoon>
Nov 03 17:39:28 user nova-compute[75463]:   </devices>
Nov 03 17:39:28 user nova-compute[75463]: </domain>
Nov 03 17:39:28 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='df055a48-5ae2-4e42-a88a-4dc636c953ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396563564',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:37:06.184005',shelved_host='user',shelved_image_id='df055a48-5ae2-4e42-a88a-4dc636c953ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG os_vif [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c735e454-e056-5ec0-9f92-8f91a186c50f', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb698a98c-a2, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb698a98c-a2, col_values=(('qos', UUID('5d2b0de3-3631-47f8-b815-021aba7ef500')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb698a98c-a2, col_values=(('external_ids', {'iface-id': 'b698a98c-a2d8-489b-acac-035363e3a121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:fb:4b', 'vm-uuid': 'fd24ad21-b275-4cf2-8a71-800c72c4b672'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: INFO os_vif [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2')
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No VIF found with MAC fa:16:3e:f6:fb:4b, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing instance network info cache due to event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.neutron [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] No waiting events found dispatching network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:28 user nova-compute[75463]: WARNING nova.compute.manager [req-ca302c49-95d1-4f87-8ee7-953525d289b1 req-2519139f-1173-4146-8237-d9d70217a1c9 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received unexpected event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 for instance with vm_state building and task_state spawning.
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'flavor' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.neutron [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updated VIF entry in instance network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG nova.network.neutron [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:28 user nova-compute[75463]: INFO nova.compute.manager [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Attaching volume aa6abb99-7338-4ca5-9d86-5791f17505ad to /dev/vdb
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7bb55815-8803-449d-ac9b-3c34cd1088ef req-2c5618bb-4216-47b8-a10d-38f406c0eced service nova] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG os_brick.utils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9579a09-3204-4697-8aaa-ec09b9bf8a25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfc1f3-3a7f-401c-83a2-6922ad6d1eff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f256c02d-75b4-4124-b471-5b3abe9e1e36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b5753-aa11-471e-8910-fefe66b1261c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:29 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:39:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c11a6e-75a6-4cd8-b219-082ebb6f9761]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG os_brick.utils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating existing volume attachment record: 3366db4d-3973-4414-93ab-6ee1bca50ae3 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] No waiting events found dispatching network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:30 user nova-compute[75463]: WARNING nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received unexpected event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 for instance with vm_state building and task_state spawning.
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:30 user nova-compute[75463]: WARNING nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:30 user nova-compute[75463]: WARNING nova.compute.manager [req-b21a7988-b85c-4336-ae99-4065c7115221 req-daeadc55-ffb1-4c7b-88ec-2ca59af0f79a service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 17:39:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:39:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance spawned successfully.
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:31 user nova-compute[75463]: INFO nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Took 7.89 seconds to spawn the instance on the hypervisor.
Nov 03 17:39:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:39:31 user nova-compute[75463]: INFO nova.compute.manager [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Took 9.23 seconds to build instance.
Nov 03 17:39:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-302c3de3-173d-4863-8c4d-f77e851b9f80 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.361s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:39:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:39:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance spawned successfully.
Nov 03 17:39:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:39:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3e51560d-d428-444b-b539-6dec50ba9667 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 39.007s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:41 user nova-compute[75463]: INFO nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Booting with volume d5e7a136-10bf-49c8-b445-ec936eb1b66c at /dev/vdb
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:41 user nova-compute[75463]: INFO nova.compute.manager [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Terminating instance
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:39:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Creating image(s)
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Ensure instance console log exists: /opt/stack/data/nova/instances/a2e29a37-38cc-4d63-9718-e7c1d17dee9b/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Start _get_guest_xml network_info=[{"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMwZiNWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2e29a37-38cc-4d63-9718-e7c1d17dee9b', 'attached_at': '', 'detached_at': '', 'volume_id': '82048dcc-6608-4036-9c8f-a37e463c2f8e', 'serial': '82048dcc-6608-4036-9c8f-a37e463c2f8e'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '4ecf6ba4-ff47-42f6-8208-426c5fead525', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1585f27a-b53e-4aac-abe1-6c0338d81eb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:39:41 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMwZiNWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:42 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:42 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:42 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4477e-a84a-4c06-9cac-5489cf984cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acc4359-e531-4471-903b-a4dc82e3ae69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2228bf1-e30b-487e-9533-ac85ef5fe7c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[296fb12a-2d39-4ca5-b348-919d1791f7cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:39:42 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:42 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a8950-856b-4834-9c41-1b64a3485028]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== get_connector_properties: return (254ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating existing volume attachment record: 582672cf-0e8e-40d8-8536-8eb8e159e23d {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaebdcf-589f-4798-b7ce-aeca8a9b5a82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e] added
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10d90a-bdc4-4a9d-833c-f64c5e2354eb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb7ca5-f165-47ac-863e-e5ab64d53619]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMwZiNWD {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMwZiNWD" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0008b-27e1-4b58-9974-767cac9f7286]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMwZiNWD'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd64f7cb-c712-48f5-9630-541d5f9a6939]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-unplugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] No waiting events found dispatching network-vif-unplugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-e6d82dd6-1aad-4883-afcf-416aa1876210 req-f9c0d94c-8150-4bf9-aad2-9903731ef059 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-unplugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40a195-d6fc-4af1-b693-ef648cc4963a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c717f9-4741-4412-ae6c-cc74dc89ad64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260]
Nov 03 17:39:42 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260] successful.
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565268b-388e-44fe-bacc-8768c2e1477c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5fa11-409e-451f-bef4-5cb9bfd95a30]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:42 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.536s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Instance destroyed successfully.
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lazy-loading 'resources' on Instance uuid 3fc4ee32-7e97-4819-b3cd-8df85c66ab98 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d416008-992b-4dcb-b869-10440838b3af]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMwZiNWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-303493848',display_name='tempest-VolumesActionsTest-instance-303493848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-303493848',id=22,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e08e396569dc4599a9f75a10796bb369',ramdisk_id='',reservation_id='r-lrfpefhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1275156279',owner_user_name='tempest-VolumesActionsTest-1275156279-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:37:27Z,user_data=None,user_id='b708d9b46f3740d2be12b5479931444a',uuid=3fc4ee32-7e97-4819-b3cd-8df85c66ab98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converting VIF {"id": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "address": "fa:16:3e:73:3d:1c", "network": {"id": "cd38c304-71d3-4af9-b567-a7a620d778f6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1586587638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e08e396569dc4599a9f75a10796bb369", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap970305bb-ae", "ovs_interfaceid": "970305bb-ae78-47e0-af9a-2dc85f7d3c26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG os_vif [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap970305bb-ae, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d3295f4-2fc4-4519-a35e-f201f7031c1e) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:42 user nova-compute[75463]: INFO os_vif [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3d:1c,bridge_name='br-int',has_traffic_filtering=True,id=970305bb-ae78-47e0-af9a-2dc85f7d3c26,network=Network(cd38c304-71d3-4af9-b567-a7a620d778f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap970305bb-ae')
Nov 03 17:39:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Deleting instance files /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98_del
Nov 03 17:39:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Deletion of /opt/stack/data/nova/instances/3fc4ee32-7e97-4819-b3cd-8df85c66ab98_del complete
Nov 03 17:39:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:42 user nova-compute[75463]: INFO nova.compute.manager [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 17:39:42 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:39:42 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.594s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '23135366164616239', 'path': '/dev/sde'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135366164616239', 'path': '/dev/sde'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1959892728',display_name='tempest-TestVolumeBootPattern-server-1959892728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1959892728',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-2ooomtp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:45Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a2e29a37-38cc-4d63-9718-e7c1d17dee9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'pci_devices' on Instance uuid a2e29a37-38cc-4d63-9718-e7c1d17dee9b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:39:43 user nova-compute[75463]:   <uuid>a2e29a37-38cc-4d63-9718-e7c1d17dee9b</uuid>
Nov 03 17:39:43 user nova-compute[75463]:   <name>instance-00000018</name>
Nov 03 17:39:43 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:39:43 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:39:43 user nova-compute[75463]:   <metadata>
Nov 03 17:39:43 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:39:43 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:39:43 user nova-compute[75463]:       <nova:name>tempest-TestVolumeBootPattern-server-1959892728</nova:name>
Nov 03 17:39:43 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:39:41</nova:creationTime>
Nov 03 17:39:43 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:39:43 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:39:43 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:39:43 user nova-compute[75463]:       <nova:owner>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:user uuid="85b5595e7da047d9965cd795b2e6a83b">tempest-TestVolumeBootPattern-79691840-project-member</nova:user>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:project uuid="88d74abcd4a349ab96ba0f188542d61c">tempest-TestVolumeBootPattern-79691840</nova:project>
Nov 03 17:39:43 user nova-compute[75463]:       </nova:owner>
Nov 03 17:39:43 user nova-compute[75463]:       <nova:ports>
Nov 03 17:39:43 user nova-compute[75463]:         <nova:port uuid="a176cc71-9e90-4ec9-baee-94adb7c02e70">
Nov 03 17:39:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 17:39:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:39:43 user nova-compute[75463]:       </nova:ports>
Nov 03 17:39:43 user nova-compute[75463]:     </nova:instance>
Nov 03 17:39:43 user nova-compute[75463]:   </metadata>
Nov 03 17:39:43 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:39:43 user nova-compute[75463]:     <system>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="serial">a2e29a37-38cc-4d63-9718-e7c1d17dee9b</entry>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="uuid">a2e29a37-38cc-4d63-9718-e7c1d17dee9b</entry>
Nov 03 17:39:43 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:39:43 user nova-compute[75463]:     </system>
Nov 03 17:39:43 user nova-compute[75463]:   </sysinfo>
Nov 03 17:39:43 user nova-compute[75463]:   <os>
Nov 03 17:39:43 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:39:43 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:39:43 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:39:43 user nova-compute[75463]:   </os>
Nov 03 17:39:43 user nova-compute[75463]:   <features>
Nov 03 17:39:43 user nova-compute[75463]:     <acpi/>
Nov 03 17:39:43 user nova-compute[75463]:     <apic/>
Nov 03 17:39:43 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:39:43 user nova-compute[75463]:   </features>
Nov 03 17:39:43 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:39:43 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:39:43 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:39:43 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:39:43 user nova-compute[75463]:   </clock>
Nov 03 17:39:43 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:39:43 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:39:43 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:39:43 user nova-compute[75463]:   </cpu>
Nov 03 17:39:43 user nova-compute[75463]:   <devices>
Nov 03 17:39:43 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:39:43 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:39:43 user nova-compute[75463]:       <source dev="/dev/sde"/>
Nov 03 17:39:43 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:39:43 user nova-compute[75463]:       <serial>82048dcc-6608-4036-9c8f-a37e463c2f8e</serial>
Nov 03 17:39:43 user nova-compute[75463]:     </disk>
Nov 03 17:39:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:39:43 user nova-compute[75463]:       <mac address="fa:16:3e:e8:72:3e"/>
Nov 03 17:39:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:39:43 user nova-compute[75463]:       <target dev="tapa176cc71-9e"/>
Nov 03 17:39:43 user nova-compute[75463]:     </interface>
Nov 03 17:39:43 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:39:43 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/a2e29a37-38cc-4d63-9718-e7c1d17dee9b/console.log" append="off"/>
Nov 03 17:39:43 user nova-compute[75463]:     </serial>
Nov 03 17:39:43 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:39:43 user nova-compute[75463]:     <video>
Nov 03 17:39:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:39:43 user nova-compute[75463]:     </video>
Nov 03 17:39:43 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:39:43 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:39:43 user nova-compute[75463]:     </rng>
Nov 03 17:39:43 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:39:43 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:39:43 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:39:43 user nova-compute[75463]:     </memballoon>
Nov 03 17:39:43 user nova-compute[75463]:   </devices>
Nov 03 17:39:43 user nova-compute[75463]: </domain>
Nov 03 17:39:43 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1959892728',display_name='tempest-TestVolumeBootPattern-server-1959892728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1959892728',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-2ooomtp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:45Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a2e29a37-38cc-4d63-9718-e7c1d17dee9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG os_vif [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9732c964-d5ca-5951-adff-b4211f4922b7', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa176cc71-9e, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa176cc71-9e, col_values=(('qos', UUID('0698d4d2-c6f5-43e5-b4d8-4bfc6ed36597')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa176cc71-9e, col_values=(('external_ids', {'iface-id': 'a176cc71-9e90-4ec9-baee-94adb7c02e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:72:3e', 'vm-uuid': 'a2e29a37-38cc-4d63-9718-e7c1d17dee9b'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:43 user nova-compute[75463]: INFO os_vif [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e')
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-0cf6a822-c302-467a-ba33-ce15151a0143 req-bff712da-dea2-4413-9575-bae823d0dd29 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-deleted-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:43 user nova-compute[75463]: INFO nova.compute.manager [req-0cf6a822-c302-467a-ba33-ce15151a0143 req-bff712da-dea2-4413-9575-bae823d0dd29 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Neutron deleted interface 970305bb-ae78-47e0-af9a-2dc85f7d3c26; detaching it from the instance and deleting it from the info cache
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-0cf6a822-c302-467a-ba33-ce15151a0143 req-bff712da-dea2-4413-9575-bae823d0dd29 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No VIF found with MAC fa:16:3e:e8:72:3e, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:39:43 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Took 1.02 seconds to deallocate network for instance.
Nov 03 17:39:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-0cf6a822-c302-467a-ba33-ce15151a0143 req-bff712da-dea2-4413-9575-bae823d0dd29 service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Detach interface failed, port_id=970305bb-ae78-47e0-af9a-2dc85f7d3c26, reason: Instance 3fc4ee32-7e97-4819-b3cd-8df85c66ab98 could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] Acquiring lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] No waiting events found dispatching network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:44 user nova-compute[75463]: WARNING nova.compute.manager [req-b32414d6-8743-4571-82db-331b149b6e12 req-6727e724-f0ea-4c6f-8575-3e64052a65cc service nova] [instance: 3fc4ee32-7e97-4819-b3cd-8df85c66ab98] Received unexpected event network-vif-plugged-970305bb-ae78-47e0-af9a-2dc85f7d3c26 for instance with vm_state deleted and task_state None.
Nov 03 17:39:44 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.610s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:44 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Deleted allocations for instance 3fc4ee32-7e97-4819-b3cd-8df85c66ab98
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-95cc4d22-c5c7-4e6e-82f2-0585b053ecd8 tempest-VolumesActionsTest-1275156279 tempest-VolumesActionsTest-1275156279-project-member] Lock "3fc4ee32-7e97-4819-b3cd-8df85c66ab98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.838s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] No waiting events found dispatching network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:46 user nova-compute[75463]: WARNING nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received unexpected event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 for instance with vm_state building and task_state spawning.
Nov 03 17:39:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] No waiting events found dispatching network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:39:46 user nova-compute[75463]: WARNING nova.compute.manager [req-502a5586-57ce-4e5f-9d85-e908ce5ed2ca req-3b1ecbb5-e301-435f-8ece-ebe39ecb24f6 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received unexpected event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 for instance with vm_state building and task_state spawning.
Nov 03 17:39:46 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:39:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Instance spawned successfully.
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:39:47 user nova-compute[75463]: INFO nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 03 17:39:47 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:39:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:47 user nova-compute[75463]: INFO nova.compute.manager [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Took 63.19 seconds to build instance.
Nov 03 17:39:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0a693e0b-1f15-43c7-9af7-0466f8436487 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 63.335s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:39:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [{"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-034f67dd-4bd4-4414-93b5-c7e77148f8eb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:39:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'flavor' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:56 user nova-compute[75463]: INFO nova.compute.manager [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Attaching volume a6e0dbb5-d0bd-4266-b3b9-658875f3b74d to /dev/vdb
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.utils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c890ac42-74fb-483b-b1e5-4a1b458701b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c33563-51c1-4799-806a-2ee80ed71293]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a0e9a-8ca1-4e9c-840f-069480a63c6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b9be8b-f329-4ad9-839b-29fa55751e77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:39:56 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9bde74-784b-49e6-a741-3ded09081069]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG os_brick.utils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating existing volume attachment record: 34041ba2-cc1b-4fc1-a6f8-84f0aa327603 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:39:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCnrbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:39:57 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:57 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:39:57 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0111945-8461-4acd-9dff-cb830207f50f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:39:57 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c7512-f72b-49fa-8e38-bbf4171488f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad] added
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d4780-d5d4-4277-bf00-636cdf68769a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62f700-59e7-40c2-b249-ab25d4eb5a9e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJCnrbDz {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJCnrbDz" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdbcb86-e5df-4b06-b7a6-1201470404c6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJCnrbDz'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b43dc7-3b4e-4a02-99ee-a2d3c095c92f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[29851a22-e5df-4e41-8d8c-eec79fd53023]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c999e6a-ffc9-4624-8ec6-ce7006337248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260]
Nov 03 17:39:57 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260] successful.
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecba00b-85ca-474c-a499-e6189d64fd5d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[79992421-c1db-4184-80cc-0f7e70d4be52]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:39:57 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:39:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[084fc3bf-8c3d-42d2-a0fd-96497e789f89]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCnrbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '26566663436643730', 'path': '/dev/sdf'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566663436643730', 'path': '/dev/sdf'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'flavor' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:39:58 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:39:58 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:39:58 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:39:58 user nova-compute[75463]:   <serial>aa6abb99-7338-4ca5-9d86-5791f17505ad</serial>
Nov 03 17:39:58 user nova-compute[75463]: </disk>
Nov 03 17:39:58 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:39:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:58:d3:fa, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e74fe055-56ea-4900-9dc8-8bac63169329 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.618s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:39:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:00 user nova-compute[75463]: INFO nova.compute.manager [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Rescuing
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:01 user nova-compute[75463]: WARNING nova.compute.manager [req-f93e9f2a-db37-4404-aa23-47f7f1722d73 req-ab144930-f316-4f4c-a9a8-dc1dc26cea36 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state active and task_state rescuing.
Nov 03 17:40:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance destroyed successfully.
Nov 03 17:40:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Attempting rescue
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75463) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 17:40:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Creating image(s)
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue" returned: 0 in 0.057s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'migration_context' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.base [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<6110a836-782f-4437-8970-dab2de7b0159> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start _get_guest_xml network_info=[{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:58:d3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.base [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<6110a836-782f-4437-8970-dab2de7b0159> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'numa_topology' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.base [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<6110a836-782f-4437-8970-dab2de7b0159> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:40:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7290MB free_disk=25.072559356689453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:02 user nova-compute[75463]: DEBUG nova.objects.base [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<6110a836-782f-4437-8970-dab2de7b0159> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-11196190',display_name='tempest-ServerRescueNegativeTestJSON-server-11196190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-11196190',id=23,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE73M3Ol7ADYyqS9FRTQwH0cZ7M/str/DVtrAgoXpl2KUqGATiIM0tygpgiTPdiIQpHC0u5uD1Qlb6Uyj1kiPxJXtW+glXUP7RSE6Cn5ECaHBOdGh7JVAMU7Z/SMEe7rcQ==',key_name='tempest-keypair-1281372959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:37:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-0p5lnn5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=6110a836-782f-4437-8970-dab2de7b0159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:58:d3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "vif_mac": "fa:16:3e:58:d3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'pci_devices' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.objects.base [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Object Instance<6110a836-782f-4437-8970-dab2de7b0159> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:40:03 user nova-compute[75463]:   <uuid>6110a836-782f-4437-8970-dab2de7b0159</uuid>
Nov 03 17:40:03 user nova-compute[75463]:   <name>instance-00000017</name>
Nov 03 17:40:03 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:40:03 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:40:03 user nova-compute[75463]:   <metadata>
Nov 03 17:40:03 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:40:03 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-11196190</nova:name>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:40:02</nova:creationTime>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:40:03 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:40:03 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:owner>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:user uuid="b1a37cd705cb44c191fe6fad731b4873">tempest-ServerRescueNegativeTestJSON-1657140794-project-member</nova:user>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:project uuid="4e727b9484bb4bdeb41aff47171cb852">tempest-ServerRescueNegativeTestJSON-1657140794</nova:project>
Nov 03 17:40:03 user nova-compute[75463]:       </nova:owner>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:40:03 user nova-compute[75463]:       <nova:ports>
Nov 03 17:40:03 user nova-compute[75463]:         <nova:port uuid="86816a37-ae7e-4391-825d-88f2c37cd0ed">
Nov 03 17:40:03 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 17:40:03 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:03 user nova-compute[75463]:       </nova:ports>
Nov 03 17:40:03 user nova-compute[75463]:     </nova:instance>
Nov 03 17:40:03 user nova-compute[75463]:   </metadata>
Nov 03 17:40:03 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:40:03 user nova-compute[75463]:     <system>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="serial">6110a836-782f-4437-8970-dab2de7b0159</entry>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="uuid">6110a836-782f-4437-8970-dab2de7b0159</entry>
Nov 03 17:40:03 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:40:03 user nova-compute[75463]:     </system>
Nov 03 17:40:03 user nova-compute[75463]:   </sysinfo>
Nov 03 17:40:03 user nova-compute[75463]:   <os>
Nov 03 17:40:03 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:40:03 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:40:03 user nova-compute[75463]:   </os>
Nov 03 17:40:03 user nova-compute[75463]:   <features>
Nov 03 17:40:03 user nova-compute[75463]:     <acpi/>
Nov 03 17:40:03 user nova-compute[75463]:     <apic/>
Nov 03 17:40:03 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:40:03 user nova-compute[75463]:   </features>
Nov 03 17:40:03 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:40:03 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:40:03 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:40:03 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:40:03 user nova-compute[75463]:   </clock>
Nov 03 17:40:03 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:40:03 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:40:03 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:40:03 user nova-compute[75463]:   </cpu>
Nov 03 17:40:03 user nova-compute[75463]:   <devices>
Nov 03 17:40:03 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:40:03 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:40:03 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue"/>
Nov 03 17:40:03 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:40:03 user nova-compute[75463]:     </disk>
Nov 03 17:40:03 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:40:03 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:40:03 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk"/>
Nov 03 17:40:03 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:40:03 user nova-compute[75463]:     </disk>
Nov 03 17:40:03 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:03 user nova-compute[75463]:       <mac address="fa:16:3e:58:d3:fa"/>
Nov 03 17:40:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:03 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:03 user nova-compute[75463]:       <target dev="tap86816a37-ae"/>
Nov 03 17:40:03 user nova-compute[75463]:     </interface>
Nov 03 17:40:03 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:40:03 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/console.log" append="off"/>
Nov 03 17:40:03 user nova-compute[75463]:     </serial>
Nov 03 17:40:03 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:40:03 user nova-compute[75463]:     <video>
Nov 03 17:40:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:03 user nova-compute[75463]:     </video>
Nov 03 17:40:03 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:40:03 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:40:03 user nova-compute[75463]:     </rng>
Nov 03 17:40:03 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:40:03 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:40:03 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:40:03 user nova-compute[75463]:     </memballoon>
Nov 03 17:40:03 user nova-compute[75463]:   </devices>
Nov 03 17:40:03 user nova-compute[75463]: </domain>
Nov 03 17:40:03 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:40:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance destroyed successfully.
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] No VIF found with MAC fa:16:3e:58:d3:fa, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a2e29a37-38cc-4d63-9718-e7c1d17dee9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance fd24ad21-b275-4cf2-8a71-800c72c4b672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a851ebda-8d2a-492f-b1c3-55e17169f606 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:03 user nova-compute[75463]: WARNING nova.compute.manager [req-07095812-7da6-42c0-9ed5-01bf1c7db77f req-2325db22-6c96-4397-8882-fe49c719596c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state active and task_state rescuing.
Nov 03 17:40:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:40:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.992s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:05 user nova-compute[75463]: WARNING nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state active and task_state rescuing.
Nov 03 17:40:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:05 user nova-compute[75463]: WARNING nova.compute.manager [req-070bf424-f899-4775-ab21-9730dfd59c45 req-7974670b-7407-4554-87e8-b2e257e14e40 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state active and task_state rescuing.
Nov 03 17:40:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-1deef53f-fc9a-477c-92ba-6eabb0999057 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:40:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:09 user nova-compute[75463]: INFO nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Booting with volume 701067cd-9973-4a72-94a1-bed1b3b13294 at /dev/vdc
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe794ad1-d8dd-4c08-919f-8b9dc1563991]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:09 user nova-compute[75463]: INFO nova.compute.manager [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Detaching volume 4fd40daf-8b75-4c1e-ba5d-d91d024be927
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152283f-3d0f-40a4-84b4-93acbf54a08e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede0887-f788-4584-bbc2-68ee9a58ca7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9a070a-d854-4048-8497-a130fbfee95e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:09 user nova-compute[75463]: INFO nova.virt.block_device [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Attempting to driver detach volume 4fd40daf-8b75-4c1e-ba5d-d91d024be927 from mountpoint /dev/vdb
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:40:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:40:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422b811-e631-4c67-a118-3d6605baab6e]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating existing volume attachment record: 475d35d9-27c6-4d6a-879d-94a2a036105d {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Attempting to detach device vdb from instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:40:09 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:09 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:40:09 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:40:09 user nova-compute[75463]:   <serial>4fd40daf-8b75-4c1e-ba5d-d91d024be927</serial>
Nov 03 17:40:09 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:40:09 user nova-compute[75463]: </disk>
Nov 03 17:40:09 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:40:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb from the persistent domain config.
Nov 03 17:40:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:40:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:40:09 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:09 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:40:09 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:40:09 user nova-compute[75463]:   <serial>4fd40daf-8b75-4c1e-ba5d-d91d024be927</serial>
Nov 03 17:40:09 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:40:09 user nova-compute[75463]: </disk>
Nov 03 17:40:09 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:40:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:40:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:40:18 user nova-compute[75463]: INFO nova.compute.claims [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Claim successful on node user
Nov 03 17:40:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:19 user nova-compute[75463]: INFO nova.compute.manager [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Unrescuing
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquired lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.778s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:40:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.policy [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34ccfe3b399641759ece85c3446c89d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5676fbfb840478f89cfb22df7f40af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [{"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Releasing lock "refresh_cache-a88be82d-522b-408e-a0a8-b707c0748d0e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'flavor' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:40:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Creating image(s)
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "/opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "/opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:20 user nova-compute[75463]: WARNING nova.compute.manager [req-dbbdfeff-1036-44ee-a26d-bfb6ad5ff120 req-ac10bb25-95ac-4a63-84e9-b48c2ffac1c3 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.262s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk 1073741824" returned: 0 in 0.057s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance destroyed successfully.
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Cannot resize image /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Ensure instance console log exists: /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:20 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Successfully created port: b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Successfully updated port: b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquired lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updating instance_info_cache with network_info: [{"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Releasing lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Instance network_info: |[{"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Start _get_guest_xml network_info=[{"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:40:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880674722',display_name='tempest-VolumesSnapshotTestJSON-instance-880674722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880674722',id=27,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnBPckBivKxHrqsQom0gsuZEmetx/EQN7ne7+3L3eBOVYZmafhQGTMpZAYheEJDJBjG33kvtRnGpuULhHQuC9zubyLuI2t87YIegUikLaiD2h5fOcXXJPRQ3yNNIMSKwg==',key_name='tempest-keypair-1807799567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-vson5uwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=1c88997c-7944-4ff0-bb95-5beb891e3b9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.objects.instance [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c88997c-7944-4ff0-bb95-5beb891e3b9a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:40:21 user nova-compute[75463]:   <uuid>1c88997c-7944-4ff0-bb95-5beb891e3b9a</uuid>
Nov 03 17:40:21 user nova-compute[75463]:   <name>instance-0000001b</name>
Nov 03 17:40:21 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:40:21 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:40:21 user nova-compute[75463]:   <metadata>
Nov 03 17:40:21 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:40:21 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-880674722</nova:name>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:40:21</nova:creationTime>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:40:21 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:40:21 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:owner>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:user uuid="34ccfe3b399641759ece85c3446c89d9">tempest-VolumesSnapshotTestJSON-751330893-project-member</nova:user>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:project uuid="b5676fbfb840478f89cfb22df7f40af8">tempest-VolumesSnapshotTestJSON-751330893</nova:project>
Nov 03 17:40:21 user nova-compute[75463]:       </nova:owner>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:40:21 user nova-compute[75463]:       <nova:ports>
Nov 03 17:40:21 user nova-compute[75463]:         <nova:port uuid="b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6">
Nov 03 17:40:21 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:40:21 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:21 user nova-compute[75463]:       </nova:ports>
Nov 03 17:40:21 user nova-compute[75463]:     </nova:instance>
Nov 03 17:40:21 user nova-compute[75463]:   </metadata>
Nov 03 17:40:21 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:40:21 user nova-compute[75463]:     <system>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="serial">1c88997c-7944-4ff0-bb95-5beb891e3b9a</entry>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="uuid">1c88997c-7944-4ff0-bb95-5beb891e3b9a</entry>
Nov 03 17:40:21 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:40:21 user nova-compute[75463]:     </system>
Nov 03 17:40:21 user nova-compute[75463]:   </sysinfo>
Nov 03 17:40:21 user nova-compute[75463]:   <os>
Nov 03 17:40:21 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:40:21 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:40:21 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:40:21 user nova-compute[75463]:   </os>
Nov 03 17:40:21 user nova-compute[75463]:   <features>
Nov 03 17:40:21 user nova-compute[75463]:     <acpi/>
Nov 03 17:40:21 user nova-compute[75463]:     <apic/>
Nov 03 17:40:21 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:40:21 user nova-compute[75463]:   </features>
Nov 03 17:40:21 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:40:21 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:40:21 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:40:21 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:40:21 user nova-compute[75463]:   </clock>
Nov 03 17:40:21 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:40:21 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:40:21 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:40:21 user nova-compute[75463]:   </cpu>
Nov 03 17:40:21 user nova-compute[75463]:   <devices>
Nov 03 17:40:21 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:40:21 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:40:21 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk"/>
Nov 03 17:40:21 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:40:21 user nova-compute[75463]:     </disk>
Nov 03 17:40:21 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:21 user nova-compute[75463]:       <mac address="fa:16:3e:c7:cd:e3"/>
Nov 03 17:40:21 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:21 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:21 user nova-compute[75463]:       <target dev="tapb9d37cbe-99"/>
Nov 03 17:40:21 user nova-compute[75463]:     </interface>
Nov 03 17:40:21 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:40:21 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/console.log" append="off"/>
Nov 03 17:40:21 user nova-compute[75463]:     </serial>
Nov 03 17:40:21 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:40:21 user nova-compute[75463]:     <video>
Nov 03 17:40:21 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:21 user nova-compute[75463]:     </video>
Nov 03 17:40:21 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:40:21 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:40:21 user nova-compute[75463]:     </rng>
Nov 03 17:40:21 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:40:21 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:40:21 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:40:21 user nova-compute[75463]:     </memballoon>
Nov 03 17:40:21 user nova-compute[75463]:   </devices>
Nov 03 17:40:21 user nova-compute[75463]: </domain>
Nov 03 17:40:21 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880674722',display_name='tempest-VolumesSnapshotTestJSON-instance-880674722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880674722',id=27,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnBPckBivKxHrqsQom0gsuZEmetx/EQN7ne7+3L3eBOVYZmafhQGTMpZAYheEJDJBjG33kvtRnGpuULhHQuC9zubyLuI2t87YIegUikLaiD2h5fOcXXJPRQ3yNNIMSKwg==',key_name='tempest-keypair-1807799567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-vson5uwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=1c88997c-7944-4ff0-bb95-5beb891e3b9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG os_vif [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1c1c5c8-fe27-5b05-88b5-f752a43a4fa4', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9d37cbe-99, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9d37cbe-99, col_values=(('qos', UUID('aeeabaa6-e691-4db4-ba5a-b35b0ea50046')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9d37cbe-99, col_values=(('external_ids', {'iface-id': 'b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:cd:e3', 'vm-uuid': '1c88997c-7944-4ff0-bb95-5beb891e3b9a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:21 user nova-compute[75463]: INFO os_vif [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99')
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No VIF found with MAC fa:16:3e:c7:cd:e3, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:22 user nova-compute[75463]: WARNING nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-changed-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Refreshing instance network info cache due to event network-changed-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Acquiring lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Acquired lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Refreshing network info cache for port b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updated VIF entry in instance network info cache for port b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updating instance_info_cache with network_info: [{"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Releasing lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:22 user nova-compute[75463]: WARNING nova.compute.manager [req-69ea98f3-22bc-4019-a96d-9d7ef5f6167d req-6d72db01-29b1-48b5-9b06-715156082185 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:40:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] No waiting events found dispatching network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:23 user nova-compute[75463]: WARNING nova.compute.manager [req-b77f988a-328e-4c07-adfa-5772fa7c037f req-990a841d-b354-4a42-ac67-687b678b6aea service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received unexpected event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 for instance with vm_state building and task_state spawning.
Nov 03 17:40:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:24 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:24 user nova-compute[75463]: WARNING nova.compute.manager [req-f7bd3b05-26b0-4039-9954-3d84f20c1d72 req-c6e2d73f-1bbf-49fc-8737-ebcaa369ab49 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b94fc-71f6-4468-afd9-5ed5f9804e9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:40:24 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393989b-136f-4a49-a9bf-9d940e57a6f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce042cb-353f-4c02-b0e4-5c780f8f864e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b3c591-f198-4250-8ad6-bc8378231b1f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43728e4d-8df3-4611-936d-f13aa0206a3b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoQyszkO'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42b913-c072-4381-a45c-3370d631e306]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[426a6e0e-df66-44c4-a5a6-c59ca88aa861]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[db29bbdd-cdb3-4c77-b9f2-e30fb215bfa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:40:24 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1464b9-8a29-499a-9295-2ae2992f1015]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a4bdc0-bdad-4861-8f0a-bce52a703d2f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:24 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b3a312-b210-4598-aedc-e7019aaf4fbc]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-dc86f287-2e15-4168-928b-23fe480bf946 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdg'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdg'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'flavor' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:40:25 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:25 user nova-compute[75463]:   <source dev="/dev/sdg"/>
Nov 03 17:40:25 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:40:25 user nova-compute[75463]:   <serial>a6e0dbb5-d0bd-4266-b3b9-658875f3b74d</serial>
Nov 03 17:40:25 user nova-compute[75463]: </disk>
Nov 03 17:40:25 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] No waiting events found dispatching network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:26 user nova-compute[75463]: WARNING nova.compute.manager [req-6b7dd2ab-6ef4-4df1-825f-4d4e3f43fb2c req-3930a490-bd72-43e0-b206-edfe841a8047 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received unexpected event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 for instance with vm_state building and task_state spawning.
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:40:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Instance spawned successfully.
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No VIF found with MAC fa:16:3e:1c:b3:b4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:40:26 user nova-compute[75463]: INFO nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 03 17:40:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:40:26 user nova-compute[75463]: INFO nova.compute.manager [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Took 7.76 seconds to build instance.
Nov 03 17:40:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4b4a4acd-71a8-429f-9ad4-9fd611935d2d tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.376s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cad8ba33-1213-4751-9942-317bf1f99136 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.904s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Stashing vm_state: active {{(pid=75463) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:40:29 user nova-compute[75463]: INFO nova.compute.claims [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Claim successful on node user
Nov 03 17:40:29 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating resource usage from migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b
Nov 03 17:40:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.767s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:29 user nova-compute[75463]: INFO nova.compute.manager [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Migrating
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:29 user nova-compute[75463]: INFO nova.compute.rpcapi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:40:30 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb is timed out.
Nov 03 17:40:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb from the live domain config.
Nov 03 17:40:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXQsuWoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:30 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37282b16-2fb8-460e-8af7-e8bf2c57ed7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:40:30 user nova-compute[75463]: No targets found.
Nov 03 17:40:30 user nova-compute[75463]: iSNS:
Nov 03 17:40:30 user nova-compute[75463]: No targets found.
Nov 03 17:40:30 user nova-compute[75463]: STATIC:
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6
Nov 03 17:40:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:30 user nova-compute[75463]: FIRMWARE:
Nov 03 17:40:30 user nova-compute[75463]: No targets found.
Nov 03 17:40:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:40:30 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:40:30 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e1dbb6-b50a-495b-97d7-e8e331a9abb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06efd3d-7675-48e6-9516-bf59e2d071c3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:30 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec584b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafdca9-3a59-4a42-b863-c189ffea953f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[936eb721-932d-435d-a6f7-530af47a4119]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7463abb7-4f7c-4ed5-97c6-f3a9ef79cfd0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b1194-a27e-42ed-a48f-a504d0e83169]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[20677db7-c9e2-43e9-978a-6da992a80305]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2025831-45cc-4ece-96b2-ad7144ab5658]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260]
Nov 03 17:40:30 user nova-compute[75463]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fd40daf-8b75-4c1e-ba5d-d91d024be927 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[18336e2e-23e8-4323-a640-6944cd65ca7a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== disconnect_volume: return (470ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Starting migrate_disk_and_power_off {{(pid=75463) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:31 user nova-compute[75463]: WARNING nova.compute.manager [req-8157b73d-c9d4-4a71-9c7e-c457740602db req-bb0ecb72-41e1-4c56-bcbe-c75cbadb7aab service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state active and task_state resize_migrating.
Nov 03 17:40:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance destroyed successfully.
Nov 03 17:40:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9caf690a-54, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e690fa-6320-4f19-9e3a-d0d37807ab60) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:32 user nova-compute[75463]: INFO os_vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:40:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d4cecf-8450-4107-b58a-d317def95fad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:40:32 user nova-compute[75463]: No targets found.
Nov 03 17:40:32 user nova-compute[75463]: iSNS:
Nov 03 17:40:32 user nova-compute[75463]: No targets found.
Nov 03 17:40:32 user nova-compute[75463]: STATIC:
Nov 03 17:40:32 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:40:32 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:32 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:32 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e
Nov 03 17:40:32 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:32 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:32 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:40:32 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:32 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:32 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:40:32 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:32 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:32 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6
Nov 03 17:40:32 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:40:32 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:40:32 user nova-compute[75463]: FIRMWARE:
Nov 03 17:40:32 user nova-compute[75463]: No targets found.
Nov 03 17:40:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:40:32 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:40:32 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a9e96-a5b8-44b1-ae35-6f8db84cbd9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[61799d2e-8d84-4dde-8e9f-28cae9f4a97a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:32 user nova-compute[75463]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:40:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec422f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d'): ({'sdg'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Removing single pathed devices sdg {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c099af-99ac-4404-9f4b-6efd814b0dca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3bc6f-941e-4705-a196-bd619ebcfbcd]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flushing IO for device /dev/sdg {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97688f-dcbb-4151-9318-6023c01bc788]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f22bb7b-06d9-4d90-bc43-6aa3987dc266]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1402ee40-6dc1-4f54-8eef-8916cf07438c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b6f57-67e3-483a-b324-282378b4a868]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:40:32 user nova-compute[75463]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1940207b-1dc7-432b-8e4c-8db22fb89f47]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== disconnect_volume: return (430ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG nova.objects.instance [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_resize/disk /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa3bd723-842d-4231-866f-c702f1a30c84 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.569s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "cp -r /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_resize/disk /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk" returned: 0 in 0.356s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_resize/disk.info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk.info {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "cp -r /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_resize/disk.info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk.info" returned: 0 in 0.055s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:33 user nova-compute[75463]: WARNING nova.compute.manager [req-175de9a8-0b17-4869-8848-6f529819d38e req-d5659e21-c48d-4639-852f-930788cc9633 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state active and task_state resize_migrating.
Nov 03 17:40:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Port 9caf690a-54b9-4d7e-a4fe-5f340846ee29 binding to destination host user is already ACTIVE {{(pid=75463) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG os_brick.utils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df98caa-c83d-44a8-8b6c-8b39499a7ba2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[58434030-7b72-4fb1-abc1-e0a61b77587f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff8a9d-6c63-4f90-a992-144fab9bf253]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea8711a-ea43-4cc9-a9d6-9f835b25b3e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:40:35 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:40:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8682bd8-84f9-43bf-841e-f3e16ea7e981]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:40:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:40:36 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:40:36 user nova-compute[75463]: DEBUG os_brick.utils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:40:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Creating image(s)
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Ensure instance console log exists: /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Start _get_guest_xml network_info=[{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRAgIFGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9afa899d-e1d6-41df-96c6-cf6b82465c7a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0bb0a0f-02fb-4599-93a4-d8c191305a50', 'serial': 'a0bb0a0f-02fb-4599-93a4-d8c191305a50'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '17111e2d-f849-4751-8226-611cbb956104', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZxtwpVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9afa899d-e1d6-41df-96c6-cf6b82465c7a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5e7a136-10bf-49c8-b445-ec936eb1b66c', 'serial': 'd5e7a136-10bf-49c8-b445-ec936eb1b66c'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '582672cf-0e8e-40d8-8536-8eb8e159e23d', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'munHdPqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9afa899d-e1d6-41df-96c6-cf6b82465c7a', 'attached_at': '', 'detached_at': '', 'volume_id': '701067cd-9973-4a72-94a1-bed1b3b13294', 'serial': '701067cd-9973-4a72-94a1-bed1b3b13294'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': '475d35d9-27c6-4d6a-879d-94a2a036105d', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:40:38 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:38 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRAgIFGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:38 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260" returned: 21 in 0.155s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e45f6-54af-469e-ac5c-3e312294554e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:40:38 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ba1e1-8cf9-4694-8617-f9d7f2bed8c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50] added
Nov 03 17:40:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[495933b2-ab8d-4245-85b2-f532cd99c5c4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d2bf2-ac5e-48eb-8170-0667b601366d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRAgIFGT {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xRAgIFGT" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[42afad58-219d-41ec-a9de-784bb466368c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xRAgIFGT'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5760a1de-c56d-46ff-90e2-8777552eb235]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01f07e-703a-44d0-84e1-8eeb1b2c8f24]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[594ba30e-a8e5-41c9-b3da-e1fc2b186197]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260]
Nov 03 17:40:39 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31df80-efde-4ee9-8d4f-b6bc98013aee]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b721f7f-a7ea-4815-81cc-3aefe49a87a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:39 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.575s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e8afc-de9b-47fc-8daf-5e08b38de04d]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:40:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRAgIFGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.618s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== connect_volume: return (1620ms) {'type': 'block', 'scsi_wwn': '23162353866396364', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162353866396364', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZxtwpVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:40 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:40 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:40 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27a8c5b-42b4-46eb-8443-428c66134403]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:40:40 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3074c78-5430-422c-82c4-c77e6a423514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c] added
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c6c2ee-aa74-4f3d-87ff-ed70f3f586c4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d17ee8b-9438-42f2-8747-975e4ff15b8b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZxtwpVL {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZxtwpVL" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fc3323-8acc-4d60-b2c2-92da6b3bc517]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZxtwpVL'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156bf37-3ef5-4f90-acd9-9cbf0dd78aad]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597b67e-f13f-4780-804c-90fa1f6b877a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a43c5-3924-4bd9-8f0d-1b24de073e1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260]
Nov 03 17:40:40 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[36058d14-fe10-43c1-ae4d-688f788a921e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b950091-4ddb-4a88-9863-da88d0fe67fc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f231a244-7936-4e1f-8951-cfda58d88ab8]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:40:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZxtwpVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23339396132393065', 'path': '/dev/sdg'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339396132393065', 'path': '/dev/sdg'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'munHdPqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:40:41 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:41 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:40:41 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f5579-2ebf-4ab2-a9ac-b2c8a75d3f7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:40:41 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d687c473-07ba-47d8-8475-0771d8685482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294] added
Nov 03 17:40:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c6c884-2db9-4eb7-9f7b-370549f0ff39]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f1460e-7625-47d2-bc70-64715cf88a56]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v munHdPqT {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v munHdPqT" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[de300f94-0673-427b-8aca-64f55e723490]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'munHdPqT'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d14735-e81b-408b-a584-2bf9ebfa617a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a36626-2f32-4444-8fb0-7b9451c5a5de]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:41 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99323fa9-2d04-4253-b77f-fdb53fccec37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260]
Nov 03 17:40:41 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260] successful.
Nov 03 17:40:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbdc4b1-b4ed-4c32-a9f4-d6f79257f400]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b87055-d11a-4e6b-8eea-cb9fb0bed201]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:40:42 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:40:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae5538f-3e13-4b6f-a54a-b245a2ef0292]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'munHdPqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23832366332623163', 'path': '/dev/sdh'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832366332623163', 'path': '/dev/sdh'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lazy-loading 'pci_devices' on Instance uuid 9afa899d-e1d6-41df-96c6-cf6b82465c7a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:40:43 user nova-compute[75463]:   <uuid>9afa899d-e1d6-41df-96c6-cf6b82465c7a</uuid>
Nov 03 17:40:43 user nova-compute[75463]:   <name>instance-00000019</name>
Nov 03 17:40:43 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:40:43 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:40:43 user nova-compute[75463]:   <metadata>
Nov 03 17:40:43 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:40:43 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:name>tempest-device-tagging-server-2131488528</nova:name>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:40:38</nova:creationTime>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:40:43 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:40:43 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:owner>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:user uuid="527aff6b1a0047fa8f5dec6271ed5f5e">tempest-TaggedBootDevicesTest-285074985-project-member</nova:user>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:project uuid="b40b758742d446419064852b47964eb1">tempest-TaggedBootDevicesTest-285074985</nova:project>
Nov 03 17:40:43 user nova-compute[75463]:       </nova:owner>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:40:43 user nova-compute[75463]:       <nova:ports>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="d3a879f7-3691-4255-a20a-8341c5421d9d">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="c25e8a44-091d-4a41-9549-63cbab062636">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="af47f12a-6e16-4fc7-86df-3ddd25b32533">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="dd29b835-6c18-4f99-821b-4cdb2998daf6">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="2dced9bb-d511-4f9a-9241-c4a1e51982e5">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:         <nova:port uuid="f5b692ca-3df7-48f3-ad72-49ab11a48d11">
Nov 03 17:40:43 user nova-compute[75463]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 03 17:40:43 user nova-compute[75463]:         </nova:port>
Nov 03 17:40:43 user nova-compute[75463]:       </nova:ports>
Nov 03 17:40:43 user nova-compute[75463]:     </nova:instance>
Nov 03 17:40:43 user nova-compute[75463]:   </metadata>
Nov 03 17:40:43 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:40:43 user nova-compute[75463]:     <system>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="serial">9afa899d-e1d6-41df-96c6-cf6b82465c7a</entry>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="uuid">9afa899d-e1d6-41df-96c6-cf6b82465c7a</entry>
Nov 03 17:40:43 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:40:43 user nova-compute[75463]:     </system>
Nov 03 17:40:43 user nova-compute[75463]:   </sysinfo>
Nov 03 17:40:43 user nova-compute[75463]:   <os>
Nov 03 17:40:43 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:40:43 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:40:43 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:40:43 user nova-compute[75463]:   </os>
Nov 03 17:40:43 user nova-compute[75463]:   <features>
Nov 03 17:40:43 user nova-compute[75463]:     <acpi/>
Nov 03 17:40:43 user nova-compute[75463]:     <apic/>
Nov 03 17:40:43 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:40:43 user nova-compute[75463]:   </features>
Nov 03 17:40:43 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:40:43 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:40:43 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:40:43 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:40:43 user nova-compute[75463]:   </clock>
Nov 03 17:40:43 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:40:43 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:40:43 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:40:43 user nova-compute[75463]:   </cpu>
Nov 03 17:40:43 user nova-compute[75463]:   <devices>
Nov 03 17:40:43 user nova-compute[75463]:     <disk type="file" device="cdrom">
Nov 03 17:40:43 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none"/>
Nov 03 17:40:43 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/disk.config"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="hda" bus="ide"/>
Nov 03 17:40:43 user nova-compute[75463]:     </disk>
Nov 03 17:40:43 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:40:43 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:43 user nova-compute[75463]:       <source dev="/dev/sdc"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <serial>a0bb0a0f-02fb-4599-93a4-d8c191305a50</serial>
Nov 03 17:40:43 user nova-compute[75463]:     </disk>
Nov 03 17:40:43 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:40:43 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:43 user nova-compute[75463]:       <source dev="/dev/sdg"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <serial>d5e7a136-10bf-49c8-b445-ec936eb1b66c</serial>
Nov 03 17:40:43 user nova-compute[75463]:     </disk>
Nov 03 17:40:43 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:40:43 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:43 user nova-compute[75463]:       <source dev="/dev/sdh"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="vdc" bus="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <serial>701067cd-9973-4a72-94a1-bed1b3b13294</serial>
Nov 03 17:40:43 user nova-compute[75463]:     </disk>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:2e:5f:98"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tapd3a879f7-36"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:38:be:b3"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tapc25e8a44-09"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:32:7b:26"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tapaf47f12a-6e"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:e9:d5:0d"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tapdd29b835-6c"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:65:5f:d3"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tap2dced9bb-d5"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:29:98:96"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tap113f934c-3c"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:40:43 user nova-compute[75463]:       <mac address="fa:16:3e:77:ca:4e"/>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:40:43 user nova-compute[75463]:       <target dev="tapf5b692ca-3d"/>
Nov 03 17:40:43 user nova-compute[75463]:     </interface>
Nov 03 17:40:43 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:40:43 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/console.log" append="off"/>
Nov 03 17:40:43 user nova-compute[75463]:     </serial>
Nov 03 17:40:43 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:40:43 user nova-compute[75463]:     <video>
Nov 03 17:40:43 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:40:43 user nova-compute[75463]:     </video>
Nov 03 17:40:43 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:40:43 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:40:43 user nova-compute[75463]:     </rng>
Nov 03 17:40:43 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:40:43 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:40:43 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:40:43 user nova-compute[75463]:     </memballoon>
Nov 03 17:40:43 user nova-compute[75463]:   </devices>
Nov 03 17:40:43 user nova-compute[75463]: </domain>
Nov 03 17:40:43 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1a9cea3-6415-536f-b0f6-cca334744522', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3a879f7-36, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3a879f7-36, col_values=(('qos', UUID('98f4fb0d-40c3-4d48-b5b4-d4b36edfd2af')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3a879f7-36, col_values=(('external_ids', {'iface-id': 'd3a879f7-3691-4255-a20a-8341c5421d9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:5f:98', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46f330fe-7f07-5f48-a2d3-74035803f618', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc25e8a44-09, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc25e8a44-09, col_values=(('qos', UUID('7d6f4774-67b4-4f36-ba80-f3de3b72daaf')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc25e8a44-09, col_values=(('external_ids', {'iface-id': 'c25e8a44-091d-4a41-9549-63cbab062636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:be:b3', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c580c39-730d-5b1f-a958-5245f5153b3f', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf47f12a-6e, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf47f12a-6e, col_values=(('qos', UUID('2ef1777c-b0d9-4199-9b87-8dce220e914a')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf47f12a-6e, col_values=(('external_ids', {'iface-id': 'af47f12a-6e16-4fc7-86df-3ddd25b32533', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:7b:26', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c48df5-3316-554b-8aa0-85aa3461a0cd', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd29b835-6c, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd29b835-6c, col_values=(('qos', UUID('e937d26c-f1f0-418d-92ad-32d116d37be3')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd29b835-6c, col_values=(('external_ids', {'iface-id': 'dd29b835-6c18-4f99-821b-4cdb2998daf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:d5:0d', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd62f5316-ae60-5610-b2ed-96b3df8a5c1e', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dced9bb-d5, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dced9bb-d5, col_values=(('qos', UUID('6e00d37b-b7fd-477b-97b3-0ed55fe2325f')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dced9bb-d5, col_values=(('external_ids', {'iface-id': '2dced9bb-d511-4f9a-9241-c4a1e51982e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:5f:d3', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6463a485-9dbd-5353-9b84-499f2ed1f158', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap113f934c-3c, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap113f934c-3c, col_values=(('qos', UUID('4c38619e-9974-4a30-9277-14482ab73936')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap113f934c-3c, col_values=(('external_ids', {'iface-id': '113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:98:96', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1594ae51-3b4f-5a98-8426-877b8a0aee34', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5b692ca-3d, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5b692ca-3d, col_values=(('qos', UUID('fc41699c-e4c7-4789-920d-21556a95ef3a')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5b692ca-3d, col_values=(('external_ids', {'iface-id': 'f5b692ca-3df7-48f3-ad72-49ab11a48d11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:ca:4e', 'vm-uuid': '9afa899d-e1d6-41df-96c6-cf6b82465c7a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:43 user nova-compute[75463]: INFO os_vif [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d')
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] No BDM found with device name hda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] No VIF found with MAC fa:16:3e:2e:5f:98, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:40:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] No VIF found with MAC fa:16:3e:65:5f:d3, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:40:43 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Using config drive
Nov 03 17:40:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Creating config drive at /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/disk.config
Nov 03 17:40:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp34kre8x8 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp34kre8x8" returned: 0 in 0.062s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:44 user nova-compute[75463]: INFO nova.compute.manager [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Detaching volume 74c00d7a-bbd3-495d-9ad0-5fb42171e7a6
Nov 03 17:40:44 user nova-compute[75463]: INFO nova.virt.block_device [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Attempting to driver detach volume 74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 from mountpoint /dev/vdc
Nov 03 17:40:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Attempting to detach device vdc from instance fd24ad21-b275-4cf2-8a71-800c72c4b672 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:40:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:40:44 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:44 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:40:44 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 17:40:44 user nova-compute[75463]:   <serial>74c00d7a-bbd3-495d-9ad0-5fb42171e7a6</serial>
Nov 03 17:40:44 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 17:40:44 user nova-compute[75463]: </disk>
Nov 03 17:40:44 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:40:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully detached device vdc from instance fd24ad21-b275-4cf2-8a71-800c72c4b672 from the persistent domain config.
Nov 03 17:40:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fd24ad21-b275-4cf2-8a71-800c72c4b672 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:40:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:40:44 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:40:44 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:40:44 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 17:40:44 user nova-compute[75463]:   <serial>74c00d7a-bbd3-495d-9ad0-5fb42171e7a6</serial>
Nov 03 17:40:44 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 17:40:44 user nova-compute[75463]: </disk>
Nov 03 17:40:44 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:40:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:40:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:46 user nova-compute[75463]: WARNING nova.compute.manager [req-7d3420b0-0e9d-4780-b9b0-d01409c1fd42 req-ce836c29-f638-4dd8-ba11-4bf307d34f83 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d for instance with vm_state building and task_state spawning.
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:46 user nova-compute[75463]: WARNING nova.compute.manager [req-d53b889a-8403-495e-8db8-5e0150228df1 req-59512508-7118-4686-bc59-8afb9d21ad6c service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 for instance with vm_state building and task_state spawning.
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:47 user nova-compute[75463]: WARNING nova.compute.manager [req-38cc3c62-b1b9-4910-895a-ca3ca3ca099e req-0aace459-3ce9-4dab-957b-8d6122555e48 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-37fdcc5b-016f-410e-b2d9-e38698305b4f req-118f68b0-df7a-4719-9f30-32149145e9b6 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:48 user nova-compute[75463]: WARNING nova.compute.manager [req-241c2b8a-695c-4331-a180-15e02c630d6c req-58d0827b-67de-4f27-a35f-b3528c671303 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 for instance with vm_state building and task_state spawning.
Nov 03 17:40:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:50 user nova-compute[75463]: WARNING nova.compute.manager [req-1439e047-6359-4c8c-aa3a-beb7a26cc65f req-f07d9e48-234b-48e3-a7a6-cd21b628de0e service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 for instance with vm_state building and task_state spawning.
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:40:50 user nova-compute[75463]: WARNING nova.compute.manager [req-6808c46f-c350-4958-a08b-2ec668a88cdf req-8c810fb4-dbe7-46d2-a6f8-2ce76dcb8bcd service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 for instance with vm_state building and task_state spawning.
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:40:50 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance spawned successfully.
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:40:50 user nova-compute[75463]: INFO nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Took 12.04 seconds to spawn the instance on the hypervisor.
Nov 03 17:40:50 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:40:50 user nova-compute[75463]: INFO nova.compute.manager [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Took 119.89 seconds to build instance.
Nov 03 17:40:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f94b7e0-8910-40a4-bc3d-b50e10e7f03f tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 119.995s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [{"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-fd24ad21-b275-4cf2-8a71-800c72c4b672" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:40:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:40:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:00 user nova-compute[75463]: INFO nova.compute.manager [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Terminating instance
Nov 03 17:41:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-unplugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] No waiting events found dispatching network-vif-unplugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-f9f969a7-a004-451f-ad35-c62ef87e474a req-7e24d4c8-5aa4-47fe-afaa-a335b947a1e8 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-unplugged-b59a1813-92bb-4ed7-af26-edb6f244c21b for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Instance destroyed successfully.
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.objects.instance [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'resources' on Instance uuid 034f67dd-4bd4-4414-93b5-c7e77148f8eb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181611941',display_name='tempest-AttachVolumeNegativeTest-server-1181611941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181611941',id=16,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIQFFrxq3ZhdAKUuZUXOJ8C90LLjSiNAdZDrtyKvLAM7PmrsUs/VqDkeqz4/T0SOkufhoOq8xG2SWhjs5Z3ysx0xdteq+o6PUDEsRSaSjvU2OjpuP8kuhZAF9rP5zR5wQ==',key_name='tempest-keypair-2080015443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:34:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-48j80idc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:34:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=034f67dd-4bd4-4414-93b5-c7e77148f8eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "address": "fa:16:3e:2a:da:e5", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb59a1813-92", "ovs_interfaceid": "b59a1813-92bb-4ed7-af26-edb6f244c21b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG os_vif [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb59a1813-92, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff450be3-abc7-4872-abd7-142b9efc5710) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:01 user nova-compute[75463]: INFO os_vif [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:da:e5,bridge_name='br-int',has_traffic_filtering=True,id=b59a1813-92bb-4ed7-af26-edb6f244c21b,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb59a1813-92')
Nov 03 17:41:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Deleting instance files /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb_del
Nov 03 17:41:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Deletion of /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb_del complete
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:01 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000010, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/034f67dd-4bd4-4414-93b5-c7e77148f8eb/disk
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:01 user nova-compute[75463]: INFO nova.compute.manager [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-390c3664-5d80-4039-9cad-9710f05a7fae req-6696821c-ee0b-46f3-a56e-b93cf3108996 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-deleted-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:02 user nova-compute[75463]: INFO nova.compute.manager [req-390c3664-5d80-4039-9cad-9710f05a7fae req-6696821c-ee0b-46f3-a56e-b93cf3108996 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Neutron deleted interface b59a1813-92bb-4ed7-af26-edb6f244c21b; detaching it from the instance and deleting it from the info cache
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.network.neutron [req-390c3664-5d80-4039-9cad-9710f05a7fae req-6696821c-ee0b-46f3-a56e-b93cf3108996 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7077MB free_disk=25.00110626220703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-390c3664-5d80-4039-9cad-9710f05a7fae req-6696821c-ee0b-46f3-a56e-b93cf3108996 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Detach interface failed, port_id=b59a1813-92bb-4ed7-af26-edb6f244c21b, reason: Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:41:02 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Took 0.94 seconds to deallocate network for instance.
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Applying migration context for instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 as it has an incoming, in-progress migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b. Migration status is post-migrating {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 17:41:02 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating resource usage from migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a2e29a37-38cc-4d63-9718-e7c1d17dee9b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance fd24ad21-b275-4cf2-8a71-800c72c4b672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a851ebda-8d2a-492f-b1c3-55e17169f606 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Starting finish_migration {{(pid=75463) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 17:41:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Creating image(s)
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] Acquiring lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] No waiting events found dispatching network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:02 user nova-compute[75463]: WARNING nova.compute.manager [req-0f4d1bfc-1fc0-4ae5-9cf0-f738a63b448a req-5bc715aa-e099-4344-8c42-c322efe07261 service nova] [instance: 034f67dd-4bd4-4414-93b5-c7e77148f8eb] Received unexpected event network-vif-plugged-b59a1813-92bb-4ed7-af26-edb6f244c21b for instance with vm_state deleted and task_state None.
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk. size=21474836480 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.809s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.699s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk 21474836480 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk 21474836480" returned: 0 in 0.068s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Ensure instance console log exists: /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start _get_guest_xml network_info=[{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '16c9d9b1-e7e6-480c-9f80-682f2f928f19', 'attached_at': '2023-11-03T17:41:02.000000', 'detached_at': '', 'volume_id': 'a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'serial': 'a6e0dbb5-d0bd-4266-b3b9-658875f3b74d'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '1289a68c-9d7b-4489-8318-bcf4675cd017', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:41:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:03 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:03 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:03 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[055096bd-7327-4c21-af63-898a45a35859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:41:03 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea4786-9c11-4cd1-996b-c838f36b88fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c60a52-4a25-4f12-8115-54013fa17b2f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690a360-1e2d-4875-b050-5c8e939d80e8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964b3da-ddbc-4973-bfbd-2f00ef8bb417]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoQyszkO'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9474d1-75f8-4056-ada6-9936e12a92ea]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fa0a8-07ae-42ff-9f32-6a70a8c4e3c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab4022e-022a-4573-b2e4-c341f23df79a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:41:03 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a4b76-733b-4d53-93c2-946096059037]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[548fbf8b-9559-4290-af35-bed87b090898]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:03 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] HCTL ('40', '-', '-', 0) found on session 25 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef324e2-f3ce-4c8f-9f52-7daea435b9b2]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching for a device in session 25 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.704s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:03 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Deleted allocations for instance 034f67dd-4bd4-4414-93b5-c7e77148f8eb
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91568cd7-5578-4654-9198-bcc6152fdab7 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "034f67dd-4bd4-4414-93b5-c7e77148f8eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.615s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdi'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdi'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:40:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:41:04 user nova-compute[75463]:   <uuid>16c9d9b1-e7e6-480c-9f80-682f2f928f19</uuid>
Nov 03 17:41:04 user nova-compute[75463]:   <name>instance-00000014</name>
Nov 03 17:41:04 user nova-compute[75463]:   <memory>2097152</memory>
Nov 03 17:41:04 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:41:04 user nova-compute[75463]:   <metadata>
Nov 03 17:41:04 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:41:04 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherB-server-510344882</nova:name>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:41:03</nova:creationTime>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:flavor name="m1.small">
Nov 03 17:41:04 user nova-compute[75463]:         <nova:memory>2048</nova:memory>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:disk>20</nova:disk>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:41:04 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:owner>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:user uuid="48c0e15fd4d84961960a5fb8a2582200">tempest-ServerActionsTestOtherB-82187790-project-member</nova:user>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:project uuid="4cbe2dfdf2f345cc9be5ef5ee6fd8e6a">tempest-ServerActionsTestOtherB-82187790</nova:project>
Nov 03 17:41:04 user nova-compute[75463]:       </nova:owner>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:41:04 user nova-compute[75463]:       <nova:ports>
Nov 03 17:41:04 user nova-compute[75463]:         <nova:port uuid="9caf690a-54b9-4d7e-a4fe-5f340846ee29">
Nov 03 17:41:04 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:41:04 user nova-compute[75463]:         </nova:port>
Nov 03 17:41:04 user nova-compute[75463]:       </nova:ports>
Nov 03 17:41:04 user nova-compute[75463]:     </nova:instance>
Nov 03 17:41:04 user nova-compute[75463]:   </metadata>
Nov 03 17:41:04 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:41:04 user nova-compute[75463]:     <system>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="serial">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="uuid">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:41:04 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:41:04 user nova-compute[75463]:     </system>
Nov 03 17:41:04 user nova-compute[75463]:   </sysinfo>
Nov 03 17:41:04 user nova-compute[75463]:   <os>
Nov 03 17:41:04 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:41:04 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:41:04 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:41:04 user nova-compute[75463]:   </os>
Nov 03 17:41:04 user nova-compute[75463]:   <features>
Nov 03 17:41:04 user nova-compute[75463]:     <acpi/>
Nov 03 17:41:04 user nova-compute[75463]:     <apic/>
Nov 03 17:41:04 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:41:04 user nova-compute[75463]:   </features>
Nov 03 17:41:04 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:41:04 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:41:04 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:41:04 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:41:04 user nova-compute[75463]:   </clock>
Nov 03 17:41:04 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:41:04 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:41:04 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:41:04 user nova-compute[75463]:   </cpu>
Nov 03 17:41:04 user nova-compute[75463]:   <devices>
Nov 03 17:41:04 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:41:04 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:41:04 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk"/>
Nov 03 17:41:04 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:41:04 user nova-compute[75463]:     </disk>
Nov 03 17:41:04 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:41:04 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:41:04 user nova-compute[75463]:       <source dev="/dev/sdi"/>
Nov 03 17:41:04 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:41:04 user nova-compute[75463]:       <serial>a6e0dbb5-d0bd-4266-b3b9-658875f3b74d</serial>
Nov 03 17:41:04 user nova-compute[75463]:     </disk>
Nov 03 17:41:04 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:41:04 user nova-compute[75463]:       <mac address="fa:16:3e:1c:b3:b4"/>
Nov 03 17:41:04 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:41:04 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:41:04 user nova-compute[75463]:       <target dev="tap9caf690a-54"/>
Nov 03 17:41:04 user nova-compute[75463]:     </interface>
Nov 03 17:41:04 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:41:04 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/console.log" append="off"/>
Nov 03 17:41:04 user nova-compute[75463]:     </serial>
Nov 03 17:41:04 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:41:04 user nova-compute[75463]:     <video>
Nov 03 17:41:04 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:41:04 user nova-compute[75463]:     </video>
Nov 03 17:41:04 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:41:04 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:41:04 user nova-compute[75463]:     </rng>
Nov 03 17:41:04 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:41:04 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:41:04 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:41:04 user nova-compute[75463]:     </memballoon>
Nov 03 17:41:04 user nova-compute[75463]:   </devices>
Nov 03 17:41:04 user nova-compute[75463]: </domain>
Nov 03 17:41:04 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:40:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1873021690-network", "vif_mac": "fa:16:3e:1c:b3:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG os_vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dceeae0-b6eb-5ad6-a55c-5ecedc58987d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9caf690a-54, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9caf690a-54, col_values=(('qos', UUID('9e37d1ee-4191-4d6b-94d6-829597215304')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9caf690a-54, col_values=(('external_ids', {'iface-id': '9caf690a-54b9-4d7e-a4fe-5f340846ee29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b3:b4', 'vm-uuid': '16c9d9b1-e7e6-480c-9f80-682f2f928f19'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:04 user nova-compute[75463]: INFO os_vif [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:41:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] No VIF found with MAC fa:16:3e:1c:b3:b4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:41:05 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fd24ad21-b275-4cf2-8a71-800c72c4b672 is timed out.
Nov 03 17:41:05 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully detached device vdc from instance fd24ad21-b275-4cf2-8a71-800c72c4b672 from the live domain config.
Nov 03 17:41:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTePYKcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:05 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff35589-88cf-4e53-94c6-6e20d1b4f7f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:41:05 user nova-compute[75463]: No targets found.
Nov 03 17:41:05 user nova-compute[75463]: iSNS:
Nov 03 17:41:05 user nova-compute[75463]: No targets found.
Nov 03 17:41:05 user nova-compute[75463]: STATIC:
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6
Nov 03 17:41:05 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:05 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:05 user nova-compute[75463]: FIRMWARE:
Nov 03 17:41:05 user nova-compute[75463]: No targets found.
Nov 03 17:41:05 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:41:05 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:41:05 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bacdc8-e63e-483f-b190-2a043656affe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c18bc3-b774-4324-86f2-968c0eb6fa04]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:05 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:05 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:05 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec25e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[79066eaa-f924-4949-96ac-08b226e0a8ec]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[415163b6-ffca-452c-be43-7f8196cbf52b]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70322c04-75da-4c9b-8438-f42135ab8e51]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eeb01e-196f-420a-96c2-1cc8a14e32ae]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.098s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab088f9-62aa-4d07-9fba-aead060cb6c5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.157s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6320d99-45d2-460e-849d-3db26c0148aa]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260]
Nov 03 17:41:05 user nova-compute[75463]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6, portal: 172.16.0.220,3260] successful.
Nov 03 17:41:05 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74c00d7a-bbd3-495d-9ad0-5fb42171e7a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd4680a-27de-4be3-833a-2b1a200066a1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.539s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] <== disconnect_volume: return (540ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:06 user nova-compute[75463]: WARNING nova.compute.manager [req-4b1169b8-f15f-4e1e-a1fe-8dcecfac3448 req-621ecc1c-ae13-4eb4-a50b-116fbd327e83 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state active and task_state resize_finish.
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG nova.objects.instance [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'flavor' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-27ed72e3-9009-4927-83c0-c61c848c314c tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.334s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:41:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance running successfully.
Nov 03 17:41:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Failed to set time: agent not configured {{(pid=75463) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0684946f-b473-4714-87eb-e1e93847f366 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] finish_migration finished successfully. {{(pid=75463) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:08 user nova-compute[75463]: WARNING nova.compute.manager [req-0debfaed-2367-4181-8544-73759b6c7f26 req-497ca9da-ba2a-407d-9043-26bc22ca5d18 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state active and task_state resize_finish.
Nov 03 17:41:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-changed-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Refreshing instance network info cache due to event network-changed-04ad84a4-3d23-48cf-8188-bbea03ad7bb2. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:41:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:41:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:41:13 user nova-compute[75463]: DEBUG nova.network.neutron [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Refreshing network info cache for port 04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG nova.network.neutron [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated VIF entry in instance network info cache for port 04ad84a4-3d23-48cf-8188-bbea03ad7bb2. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG nova.network.neutron [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ed3f74ed-96a9-4c20-82ba-bde474b87254 req-5bb66c18-8dda-4843-87c3-6c46dfdff4d5 service nova] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'flavor' on Instance uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:14 user nova-compute[75463]: INFO nova.compute.manager [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Attaching volume de0b8fcf-4b83-4980-bfa1-77d6a74e2898 to /dev/vdb
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.utils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc88f8-00c6-4cfd-b91e-566375a5d9eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[09848916-eb07-43cf-8ad3-dc2ce69f70a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d5371c-cd0c-432d-9ac2-696aa1fad477]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d6f05-6750-4e3c-ad5d-644967bce313]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:41:14 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:41:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe53080-1e38-4819-9186-2eb0d48635f3]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG os_brick.utils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:14 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating existing volume attachment record: 48bd7de9-1f92-4254-aa21-6375da6a87f7 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:41:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:25 user nova-compute[75463]: INFO nova.compute.manager [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Terminating instance
Nov 03 17:41:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-unplugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] No waiting events found dispatching network-vif-unplugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-6e166796-5a65-4b64-95d2-671b8f24d8c9 req-dc88fa95-54d8-4a1e-b27b-fd547c974eda service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-unplugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:41:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Instance destroyed successfully.
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'resources' on Instance uuid a2e29a37-38cc-4d63-9718-e7c1d17dee9b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:38:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1959892728',display_name='tempest-TestVolumeBootPattern-server-1959892728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1959892728',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-2ooomtp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:39:48Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a2e29a37-38cc-4d63-9718-e7c1d17dee9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "address": "fa:16:3e:e8:72:3e", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa176cc71-9e", "ovs_interfaceid": "a176cc71-9e90-4ec9-baee-94adb7c02e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_vif [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa176cc71-9e, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0698d4d2-c6f5-43e5-b4d8-4bfc6ed36597) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:26 user nova-compute[75463]: INFO os_vif [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:3e,bridge_name='br-int',has_traffic_filtering=True,id=a176cc71-9e90-4ec9-baee-94adb7c02e70,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa176cc71-9e')
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMwZiNWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a27ae-07f1-4500-b2a5-6d0abe03daa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:41:26 user nova-compute[75463]: No targets found.
Nov 03 17:41:26 user nova-compute[75463]: iSNS:
Nov 03 17:41:26 user nova-compute[75463]: No targets found.
Nov 03 17:41:26 user nova-compute[75463]: STATIC:
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:41:26 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:26 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:26 user nova-compute[75463]: FIRMWARE:
Nov 03 17:41:26 user nova-compute[75463]: No targets found.
Nov 03 17:41:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:41:26 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:41:26 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3898969-db00-4296-b8ea-b46fd3abbc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d76ac4-0be2-47d1-849a-6e5e1dafa2f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:26 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c129990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e'): ({'sde'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Removing single pathed devices sde {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba549d-d133-44c8-8a63-bad17559eaaf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e0c2cb-d465-421a-b4d1-e56f7ca34184]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flushing IO for device /dev/sde {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13c2a5-d9f8-41f5-a46b-013ff5894e02]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db16469-4389-433e-82fc-961dbb94dec6]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] SCSI volumes sde have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db8fc5-1b65-480d-880c-42da647b54df]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd04bf3-7c67-4ed8-9324-fd5f7a373aea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260]
Nov 03 17:41:26 user nova-compute[75463]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e, portal: 172.16.0.220,3260] successful.
Nov 03 17:41:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82048dcc-6608-4036-9c8f-a37e463c2f8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5813b3-8a8f-4f0d-be35-c363aea59adc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== disconnect_volume: return (367ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:41:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Deleting instance files /opt/stack/data/nova/instances/a2e29a37-38cc-4d63-9718-e7c1d17dee9b_del
Nov 03 17:41:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Deletion of /opt/stack/data/nova/instances/a2e29a37-38cc-4d63-9718-e7c1d17dee9b_del complete
Nov 03 17:41:27 user nova-compute[75463]: INFO nova.compute.manager [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 03 17:41:27 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:41:27 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:41:27 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:41:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:27 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:27 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Took 0.50 seconds to deallocate network for instance.
Nov 03 17:41:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-f983e665-8a32-4768-8b34-ed54bd91aed3 req-b4e101f5-7830-4d59-9b74-7cff893fa5bd service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-deleted-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] Acquiring lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] No waiting events found dispatching network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:28 user nova-compute[75463]: WARNING nova.compute.manager [req-21494e87-a9ff-4e78-a836-318861ce6aa2 req-f6d84d8c-db4a-468c-9232-5b617d8a4052 service nova] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Received unexpected event network-vif-plugged-a176cc71-9e90-4ec9-baee-94adb7c02e70 for instance with vm_state active and task_state deleting.
Nov 03 17:41:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:33 user nova-compute[75463]: INFO nova.compute.manager [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Took 5.45 seconds to detach 1 volumes for instance.
Nov 03 17:41:33 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a2e29a37-38cc-4d63-9718-e7c1d17dee9b] Deleting volume: 82048dcc-6608-4036-9c8f-a37e463c2f8e {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 17:41:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:33 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:41:33 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:41:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:33 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance a2e29a37-38cc-4d63-9718-e7c1d17dee9b
Nov 03 17:41:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d49c941f-548f-4e3f-ba15-a42e32b2dfe9 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a2e29a37-38cc-4d63-9718-e7c1d17dee9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.940s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:34 user nova-compute[75463]: INFO nova.compute.manager [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Terminating instance
Nov 03 17:41:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-60e2ec7a-d469-4e2f-8010-3e2215ade866 req-ce1255b1-9b9e-400d-9205-05e2b9a149f0 service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-unplugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:41:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Instance destroyed successfully.
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'resources' on Instance uuid fd24ad21-b275-4cf2-8a71-800c72c4b672 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-809221533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-809221533',id=17,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEvK3WNl4mjZ5kmDZ3gCW61q5s0+za8AnwCv4gF2hOpefVCWrL0iZpfJIE8VYGFMwK4eZHCX36lFJT1FkV6pFyEjhYPnpyIqLommQkDwhaG09NARsAsOOFJNS1/eYLalw==',key_name='tempest-keypair-396563564',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-d4rj0bbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=fd24ad21-b275-4cf2-8a71-800c72c4b672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "b698a98c-a2d8-489b-acac-035363e3a121", "address": "fa:16:3e:f6:fb:4b", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb698a98c-a2", "ovs_interfaceid": "b698a98c-a2d8-489b-acac-035363e3a121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG os_vif [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb698a98c-a2, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d2b0de3-3631-47f8-b815-021aba7ef500) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:35 user nova-compute[75463]: INFO os_vif [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:fb:4b,bridge_name='br-int',has_traffic_filtering=True,id=b698a98c-a2d8-489b-acac-035363e3a121,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb698a98c-a2')
Nov 03 17:41:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Deleting instance files /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672_del
Nov 03 17:41:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Deletion of /opt/stack/data/nova/instances/fd24ad21-b275-4cf2-8a71-800c72c4b672_del complete
Nov 03 17:41:35 user nova-compute[75463]: INFO nova.compute.manager [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 17:41:35 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:41:35 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:41:36 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:36 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Took 1.04 seconds to deallocate network for instance.
Nov 03 17:41:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-a45fb2ca-0c47-4247-b5ea-d13525b45e83 req-15e9b699-01b9-4e4e-bc29-4a9455b8b39d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-deleted-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] Acquiring lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] No waiting events found dispatching network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:37 user nova-compute[75463]: WARNING nova.compute.manager [req-9a5addbd-ef69-47cc-850d-4137c320b6f3 req-8259b6f5-f274-47b5-a7d0-8a337f2a7d1d service nova] [instance: fd24ad21-b275-4cf2-8a71-800c72c4b672] Received unexpected event network-vif-plugged-b698a98c-a2d8-489b-acac-035363e3a121 for instance with vm_state deleted and task_state None.
Nov 03 17:41:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:37 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Deleted allocations for instance fd24ad21-b275-4cf2-8a71-800c72c4b672
Nov 03 17:41:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f36f7042-73c0-4c25-b9f4-6744482ffdd9 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "fd24ad21-b275-4cf2-8a71-800c72c4b672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.717s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsaCdeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:39 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[52799fda-052f-4722-95ea-745679bc8ef8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:41:39 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec41b714-1847-4104-9ba1-fdcc76924c25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898] added
Nov 03 17:41:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dedcd4-8a68-4b42-8147-48651d1ada94]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7410c2a-6128-4f9c-8214-2b96907329ab]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UsaCdeYL {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UsaCdeYL" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ddac70-aea4-4b8b-a4a0-c9e2a361ae63]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UsaCdeYL'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0028d52-b967-410e-a662-31fd2e56105e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d5c1d1-ee5a-4471-b799-56256e74df78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2765c-73b6-45c2-8d47-ebbc67026ff8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260]
Nov 03 17:41:40 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260] successful.
Nov 03 17:41:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[745d2e97-842e-4058-88bd-9410645dd56a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f56e50-182c-46b6-8fe1-e85c825f22f5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:40 user nova-compute[75463]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)
Nov 03 17:41:40 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ff24e7-6cfe-4107-97e0-4aca306e8700]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsaCdeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:41:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23665373233633136', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665373233633136', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'flavor' on Instance uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:41:41 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:41:41 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:41:41 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:41:41 user nova-compute[75463]:   <serial>de0b8fcf-4b83-4980-bfa1-77d6a74e2898</serial>
Nov 03 17:41:41 user nova-compute[75463]: </disk>
Nov 03 17:41:41 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No VIF found with MAC fa:16:3e:fe:ac:53, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:41:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a4f4ba1f-50b8-4567-9fcc-b9a433ca3bb6 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.478s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:43 user nova-compute[75463]: INFO nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Rebuilding instance
Nov 03 17:41:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-vif-unplugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] No waiting events found dispatching network-vif-unplugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:43 user nova-compute[75463]: WARNING nova.compute.manager [req-d082602f-519c-48de-996f-1dae598bb0aa req-5d43fff9-4109-4496-b49d-69c1be43cc95 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received unexpected event network-vif-unplugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 for instance with vm_state active and task_state rebuilding.
Nov 03 17:41:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance destroyed successfully.
Nov 03 17:41:44 user nova-compute[75463]: INFO nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Detaching volume de0b8fcf-4b83-4980-bfa1-77d6a74e2898
Nov 03 17:41:44 user nova-compute[75463]: INFO nova.virt.block_device [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Attempting to driver detach volume de0b8fcf-4b83-4980-bfa1-77d6a74e2898 from mountpoint /dev/vdb
Nov 03 17:41:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Attempting to detach device vdb from instance a851ebda-8d2a-492f-b1c3-55e17169f606 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:41:44 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:41:44 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:41:44 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:41:44 user nova-compute[75463]:   <serial>de0b8fcf-4b83-4980-bfa1-77d6a74e2898</serial>
Nov 03 17:41:44 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:41:44 user nova-compute[75463]: </disk>
Nov 03 17:41:44 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:41:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully detached device vdb from instance a851ebda-8d2a-492f-b1c3-55e17169f606 from the persistent domain config.
Nov 03 17:41:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsaCdeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:44 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4578f2-5bc4-4077-ab61-6dc1e83ab835]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:41:44 user nova-compute[75463]: No targets found.
Nov 03 17:41:44 user nova-compute[75463]: iSNS:
Nov 03 17:41:44 user nova-compute[75463]: No targets found.
Nov 03 17:41:44 user nova-compute[75463]: STATIC:
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:41:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:44 user nova-compute[75463]: FIRMWARE:
Nov 03 17:41:44 user nova-compute[75463]: No targets found.
Nov 03 17:41:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:41:44 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:41:44 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2838720-5cc2-4687-aa15-8f477317a9ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cacf43-a530-4201-a7fe-9edbc0077be7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:44 user nova-compute[75463]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 (non-flash)
Nov 03 17:41:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0142c6cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb7b23-33bc-4fbf-824d-775bfedd4fc9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25fba4e-cde5-4d09-a25d-ccfe02d9d1ba]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9639f716-5645-4ad8-9fa2-adab03dddb33]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b3cee-44b3-4b94-866b-66e6c5a88d8b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f69ce8d-d831-44a7-9a39-c25a063ca039]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfd6926-14c6-4d2c-831b-6acd6913a7dd]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260]
Nov 03 17:41:44 user nova-compute[75463]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898, portal: 172.16.0.220,3260] successful.
Nov 03 17:41:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c9f10-acff-4c6f-98a0-e8d982a2d0ae]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== disconnect_volume: return (342ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] No waiting events found dispatching network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:45 user nova-compute[75463]: WARNING nova.compute.manager [req-986cab36-f327-47f0-a78e-5eee7a2bb508 req-06929232-7187-4b05-95c8-e4237a67899f service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received unexpected event network-vif-plugged-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 for instance with vm_state active and task_state rebuilding.
Nov 03 17:41:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:47 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:51 user nova-compute[75463]: INFO nova.compute.manager [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Unrescuing
Nov 03 17:41:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:41:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:41:51 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'flavor' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:52 user nova-compute[75463]: WARNING nova.compute.manager [req-afd7c914-386b-4dc8-8b47-d45e38abecd7 req-84690ce2-7de1-4d32-a4fc-b77bd906844f service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:41:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:53 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance destroyed successfully.
Nov 03 17:41:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:54 user nova-compute[75463]: WARNING nova.compute.manager [req-e107f0f7-e23b-40aa-af14-3e3dadbcd023 req-5fd93238-17d9-475c-9cc8-906a7668332d service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:41:55 user nova-compute[75463]: INFO nova.compute.claims [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Claim successful on node user
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:41:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.policy [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeadce7781c4ef7b888094b5707750a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27744d9d47034ad4bdc36f50bb525282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:41:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Creating image(s)
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "/opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk 1073741824" returned: 0 in 0.064s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Successfully created port: 94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:41:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance destroyed successfully.
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1090028409',display_name='tempest-ServerActionsTestOtherA-server-1376365290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1090028409',id=26,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1AfZwh7k3+Aa+ekV9iFc4vdtYdcheXgNcrVDlBwPj/lX2qbd1MLGvloMtCPCTW2ydXVo9USSKtwP9n4iGmSyn4oQwVDl4e3b1qnqC8NlMqQ/jgmeNzZVPfa5EwHLNUhQ==',key_name='tempest-keypair-884601012',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-k3ij7xgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:41:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=a851ebda-8d2a-492f-b1c3-55e17169f606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_vif [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ad84a4-3d, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5659ff45-9e68-444e-b255-03463e15fbdb) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:56 user nova-compute[75463]: INFO os_vif [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d')
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsaCdeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:56 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0398ba89-f99e-4b83-a78f-d6168fd5b09b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:41:56 user nova-compute[75463]: No targets found.
Nov 03 17:41:56 user nova-compute[75463]: iSNS:
Nov 03 17:41:56 user nova-compute[75463]: No targets found.
Nov 03 17:41:56 user nova-compute[75463]: STATIC:
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:41:56 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:41:56 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:41:56 user nova-compute[75463]: FIRMWARE:
Nov 03 17:41:56 user nova-compute[75463]: No targets found.
Nov 03 17:41:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:41:56 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:41:56 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae35886f-086b-4c7b-9252-85d717818834]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5379e-9011-4d40-a9d1-f54e68292fc5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:41:56 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:41:56 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec585750>, {}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Disconnecting from: [] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.134s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== disconnect_volume: return (136ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:41:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Deleting instance files /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606_del
Nov 03 17:41:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Deletion of /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606_del complete
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Cannot resize image /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Ensure instance console log exists: /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:56 user nova-compute[75463]: WARNING nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:56 user nova-compute[75463]: WARNING nova.compute.manager [req-dec0c0d9-3222-4326-9abe-8a4c554e30c4 req-2e5bf1ac-a8bb-42f2-a89c-57bc62d81829 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state rescued and task_state unrescuing.
Nov 03 17:41:56 user nova-compute[75463]: INFO nova.virt.block_device [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Booting with volume de0b8fcf-4b83-4980-bfa1-77d6a74e2898 at /dev/vdb
Nov 03 17:41:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.utils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ece8b6-a4ee-490c-b8d9-82c03900edf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6730f420-7dca-43e1-8467-bed76738bfcd tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fca04e-48d2-4f4e-8db2-2e4e6bd6224f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa34a66-a358-4be0-a207-c7ddc0e5b28b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375375b-d9c9-4160-8f8b-e7fb29e3f157]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:41:57 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46447258-b235-45ff-9d26-c9cd941cc26b]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Successfully updated port: 94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_brick.utils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating existing volume attachment record: b5296da4-3b03-4dd5-ba7b-8363b98f9f88 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquired lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-changed-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Refreshing instance network info cache due to event network-changed-94333704-e017-45ce-9ae2-4e72f7606a68. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] Acquiring lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'a851ebda-8d2a-492f-b1c3-55e17169f606' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a851ebda-8d2a-492f-b1c3-55e17169f606' (instance-0000001a)
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updating instance_info_cache with network_info: [{"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Releasing lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Instance network_info: |[{"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] Acquired lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Refreshing network info cache for port 94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Start _get_guest_xml network_info=[{"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046243823',display_name='tempest-AttachVolumeNegativeTest-server-1046243823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046243823',id=28,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3NZnZzKjTzT3seOaptLMUiwM4+woWCHmB3XHwO7bQpHfixffdgWF+Tmh3SmNb2i+6k+q9zFZzYCELIh08wyXCygur4wlCjtYjpKVLrFYU74zQLhL8kSHLN4rvYIfCEqg==',key_name='tempest-keypair-1991438825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-ow67ehff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=83aae736-2183-4d61-a81b-607ac62688cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.objects.instance [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'pci_devices' on Instance uuid 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:41:57 user nova-compute[75463]:   <uuid>83aae736-2183-4d61-a81b-607ac62688cb</uuid>
Nov 03 17:41:57 user nova-compute[75463]:   <name>instance-0000001c</name>
Nov 03 17:41:57 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:41:57 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:41:57 user nova-compute[75463]:   <metadata>
Nov 03 17:41:57 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:41:57 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1046243823</nova:name>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:41:57</nova:creationTime>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:41:57 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:41:57 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:owner>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:user uuid="7aeadce7781c4ef7b888094b5707750a">tempest-AttachVolumeNegativeTest-731383677-project-member</nova:user>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:project uuid="27744d9d47034ad4bdc36f50bb525282">tempest-AttachVolumeNegativeTest-731383677</nova:project>
Nov 03 17:41:57 user nova-compute[75463]:       </nova:owner>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:41:57 user nova-compute[75463]:       <nova:ports>
Nov 03 17:41:57 user nova-compute[75463]:         <nova:port uuid="94333704-e017-45ce-9ae2-4e72f7606a68">
Nov 03 17:41:57 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 03 17:41:57 user nova-compute[75463]:         </nova:port>
Nov 03 17:41:57 user nova-compute[75463]:       </nova:ports>
Nov 03 17:41:57 user nova-compute[75463]:     </nova:instance>
Nov 03 17:41:57 user nova-compute[75463]:   </metadata>
Nov 03 17:41:57 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:41:57 user nova-compute[75463]:     <system>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="serial">83aae736-2183-4d61-a81b-607ac62688cb</entry>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="uuid">83aae736-2183-4d61-a81b-607ac62688cb</entry>
Nov 03 17:41:57 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:41:57 user nova-compute[75463]:     </system>
Nov 03 17:41:57 user nova-compute[75463]:   </sysinfo>
Nov 03 17:41:57 user nova-compute[75463]:   <os>
Nov 03 17:41:57 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:41:57 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:41:57 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:41:57 user nova-compute[75463]:   </os>
Nov 03 17:41:57 user nova-compute[75463]:   <features>
Nov 03 17:41:57 user nova-compute[75463]:     <acpi/>
Nov 03 17:41:57 user nova-compute[75463]:     <apic/>
Nov 03 17:41:57 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:41:57 user nova-compute[75463]:   </features>
Nov 03 17:41:57 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:41:57 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:41:57 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:41:57 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:41:57 user nova-compute[75463]:   </clock>
Nov 03 17:41:57 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:41:57 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:41:57 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:41:57 user nova-compute[75463]:   </cpu>
Nov 03 17:41:57 user nova-compute[75463]:   <devices>
Nov 03 17:41:57 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:41:57 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:41:57 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk"/>
Nov 03 17:41:57 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:41:57 user nova-compute[75463]:     </disk>
Nov 03 17:41:57 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:41:57 user nova-compute[75463]:       <mac address="fa:16:3e:33:3e:41"/>
Nov 03 17:41:57 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:41:57 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:41:57 user nova-compute[75463]:       <target dev="tap94333704-e0"/>
Nov 03 17:41:57 user nova-compute[75463]:     </interface>
Nov 03 17:41:57 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:41:57 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/console.log" append="off"/>
Nov 03 17:41:57 user nova-compute[75463]:     </serial>
Nov 03 17:41:57 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:41:57 user nova-compute[75463]:     <video>
Nov 03 17:41:57 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:41:57 user nova-compute[75463]:     </video>
Nov 03 17:41:57 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:41:57 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:41:57 user nova-compute[75463]:     </rng>
Nov 03 17:41:57 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:41:57 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:41:57 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:41:57 user nova-compute[75463]:     </memballoon>
Nov 03 17:41:57 user nova-compute[75463]:   </devices>
Nov 03 17:41:57 user nova-compute[75463]: </domain>
Nov 03 17:41:57 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046243823',display_name='tempest-AttachVolumeNegativeTest-server-1046243823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046243823',id=28,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3NZnZzKjTzT3seOaptLMUiwM4+woWCHmB3XHwO7bQpHfixffdgWF+Tmh3SmNb2i+6k+q9zFZzYCELIh08wyXCygur4wlCjtYjpKVLrFYU74zQLhL8kSHLN4rvYIfCEqg==',key_name='tempest-keypair-1991438825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-ow67ehff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=83aae736-2183-4d61-a81b-607ac62688cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG os_vif [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9098f56-0a36-5a76-99ef-f5f9f8460b3e', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94333704-e0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94333704-e0, col_values=(('qos', UUID('03c0e992-44a8-4f4c-a11b-1778ecea7d33')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94333704-e0, col_values=(('external_ids', {'iface-id': '94333704-e017-45ce-9ae2-4e72f7606a68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3e:41', 'vm-uuid': '83aae736-2183-4d61-a81b-607ac62688cb'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:57 user nova-compute[75463]: INFO os_vif [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0')
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:41:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:33:3e:41, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updated VIF entry in instance network info cache for port 94333704-e017-45ce-9ae2-4e72f7606a68. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updating instance_info_cache with network_info: [{"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0dd2cd6-82f5-4db7-8cc2-1f96c6ad1d10 req-c2ad6e84-5850-4353-a77f-d8ec1371daaa service nova] Releasing lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] No waiting events found dispatching network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:41:59 user nova-compute[75463]: WARNING nova.compute.manager [req-27ab6229-4523-4b97-bb2e-6774f6f38ca3 req-cb647c6f-204e-4726-86ac-10a612380a4b service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received unexpected event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 for instance with vm_state building and task_state spawning.
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:41:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] No waiting events found dispatching network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:02 user nova-compute[75463]: WARNING nova.compute.manager [req-b1bcf752-4bb8-4dc8-937f-ae70553934e5 req-80f11928-afa8-4a06-9376-b5d9b9df3125 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received unexpected event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 for instance with vm_state building and task_state spawning.
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:42:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:02 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.04300308227539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Instance spawned successfully.
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:02 user nova-compute[75463]: INFO nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Applying migration context for instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 as it has an incoming, in-progress migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b. Migration status is finished {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 17:42:02 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating resource usage from migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 263ef766-2fbd-4277-b464-2b654a5029ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a88be82d-522b-408e-a0a8-b707c0748d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a851ebda-8d2a-492f-b1c3-55e17169f606 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 83aae736-2183-4d61-a81b-607ac62688cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:42:02 user nova-compute[75463]: INFO nova.compute.manager [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Took 7.46 seconds to build instance.
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-774ed5e4-86c6-442d-8363-a816f1f7e68e tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.596s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:42:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:42:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-changed-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Refreshing instance network info cache due to event network-changed-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] Acquiring lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] Acquired lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Refreshing network info cache for port b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.008s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'flavor' on Instance uuid 1c88997c-7944-4ff0-bb95-5beb891e3b9a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Ignoring supplied device name: /dev/vdb
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:09 user nova-compute[75463]: INFO nova.compute.manager [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Attaching volume 4dcbb020-1412-456f-8e93-c78260bec37f to /dev/vdb
Nov 03 17:42:09 user nova-compute[75463]: DEBUG os_brick.utils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updated VIF entry in instance network info cache for port b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updating instance_info_cache with network_info: [{"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d1be1-a536-45cf-accd-9b26544947f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0f931ec0-a2c3-4cba-8601-59e7c83534df req-2d7057ca-f3a5-492a-ac4f-eb95b3752543 service nova] Releasing lock "refresh_cache-1c88997c-7944-4ff0-bb95-5beb891e3b9a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949de6d-ab1b-415f-95e3-523a79953eee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[97961a89-2c3a-4877-a233-925334b91020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8bf812-852f-4085-a076-dd219c9fa1f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:42:09 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:42:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260ae96-7f65-438a-8e99-82ee21b898f4]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG os_brick.utils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updating existing volume attachment record: 6dc3df43-07d1-4a9b-961e-85321a400011 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:10 user nova-compute[75463]: INFO nova.compute.manager [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Terminating instance
Nov 03 17:42:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-4f5c40f9-9cc5-4954-9374-9f9fd0806483 req-9ae9b829-628a-462a-96c1-aa394ee68209 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-unplugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Instance destroyed successfully.
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'resources' on Instance uuid a88be82d-522b-408e-a0a8-b707c0748d0e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1927141613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1927141613',id=19,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-7uzamay3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:26Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=a88be82d-522b-408e-a0a8-b707c0748d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "address": "fa:16:3e:c5:96:c4", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f252cf3-59", "ovs_interfaceid": "6f252cf3-5926-40f0-835c-168ac8b0db4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_vif [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f252cf3-59, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67b61da8-3427-4dd1-8839-e8ba65415608) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:11 user nova-compute[75463]: INFO os_vif [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:96:c4,bridge_name='br-int',has_traffic_filtering=True,id=6f252cf3-5926-40f0-835c-168ac8b0db4d,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f252cf3-59')
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPWjDemJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:11 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37619ea0-a24c-4bf3-8d15-eb107bba145e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:42:11 user nova-compute[75463]: No targets found.
Nov 03 17:42:11 user nova-compute[75463]: iSNS:
Nov 03 17:42:11 user nova-compute[75463]: No targets found.
Nov 03 17:42:11 user nova-compute[75463]: STATIC:
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:42:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:11 user nova-compute[75463]: FIRMWARE:
Nov 03 17:42:11 user nova-compute[75463]: No targets found.
Nov 03 17:42:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:42:11 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:42:11 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e69bad-4ec9-40c0-bf76-cc92b4845c29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679f515-ade6-49a9-9412-ea75b7ab9089]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:11 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec4908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d387a-be3e-4a23-80bf-4ed0a6f355f5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d271c-80d7-4e15-a28c-673dab4b3de1]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[102056b7-c425-4c6c-9d40-f1ca585980bf]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8858a9b0-ecc4-47ad-84e8-cf80c2e693b3]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_399372c8', '/dev/disk/by-id/scsi-1SCST_BIO399372c8-2f4eaaf9f26fad1d', '/dev/disk/by-id/scsi-23266346561616639') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0ccb7d-0c52-4936-970b-9c4de51f4444]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f41bd6-65be-4918-b3a7-86141c726845]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a206e3d7-3c67-4f18-b2e8-189cb4ee1248]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260]
Nov 03 17:42:11 user nova-compute[75463]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c887218-4695-4d86-8576-bf8a0ae84566 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf5a53-5f26-4b65-a4af-2200bb0d4ffb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] <== disconnect_volume: return (384ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:42:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Deleting instance files /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e_del
Nov 03 17:42:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Deletion of /opt/stack/data/nova/instances/a88be82d-522b-408e-a0a8-b707c0748d0e_del complete
Nov 03 17:42:11 user nova-compute[75463]: INFO nova.compute.manager [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 03 17:42:11 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:42:11 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:42:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Took 0.50 seconds to deallocate network for instance.
Nov 03 17:42:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-02301cb2-3660-405d-bcc2-40a13caaefcc req-a7e4049f-ea93-406f-954d-9bee3cb26c3a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-deleted-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:12 user nova-compute[75463]: INFO nova.compute.manager [req-02301cb2-3660-405d-bcc2-40a13caaefcc req-a7e4049f-ea93-406f-954d-9bee3cb26c3a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Neutron deleted interface 6f252cf3-5926-40f0-835c-168ac8b0db4d; detaching it from the instance and deleting it from the info cache
Nov 03 17:42:12 user nova-compute[75463]: DEBUG nova.network.neutron [req-02301cb2-3660-405d-bcc2-40a13caaefcc req-a7e4049f-ea93-406f-954d-9bee3cb26c3a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-02301cb2-3660-405d-bcc2-40a13caaefcc req-a7e4049f-ea93-406f-954d-9bee3cb26c3a service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Detach interface failed, port_id=6f252cf3-5926-40f0-835c-168ac8b0db4d, reason: Instance a88be82d-522b-408e-a0a8-b707c0748d0e could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:42:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] Acquiring lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] No waiting events found dispatching network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:13 user nova-compute[75463]: WARNING nova.compute.manager [req-cd42731c-263d-4a7f-8fb4-74f33838314b req-464a8d2a-e366-4607-8baa-c2fda8f82245 service nova] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Received unexpected event network-vif-plugged-6f252cf3-5926-40f0-835c-168ac8b0db4d for instance with vm_state active and task_state deleting.
Nov 03 17:42:13 user nova-compute[75463]: INFO nova.compute.manager [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: a88be82d-522b-408e-a0a8-b707c0748d0e] Took 0.96 seconds to detach 1 volumes for instance.
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.836s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:14 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Deleted allocations for instance a88be82d-522b-408e-a0a8-b707c0748d0e
Nov 03 17:42:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e295ce05-831a-4f69-8148-1df5a8ee8845 tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "a88be82d-522b-408e-a0a8-b707c0748d0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.821s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Port 9caf690a-54b9-4d7e-a4fe-5f340846ee29 binding to destination host user is already ACTIVE {{(pid=75463) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 17:42:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Creating tmpfile /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/tmpucpl6aiz to verify with other compute node that the instance is on the same shared storage. {{(pid=75463) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:19 user nova-compute[75463]: WARNING nova.compute.manager [req-174476e0-70b0-49c2-b788-f9c93849c0ff req-215b3ab8-08d7-4534-8e23-87c095a5baa4 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state resized and task_state resize_reverting.
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance destroyed successfully.
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.objects.instance [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'resources' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9caf690a-54, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e37d1ee-4191-4d6b-94d6-829597215304) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:20 user nova-compute[75463]: INFO os_vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:20 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0efff-3008-4788-9c81-99b5fb766f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:42:20 user nova-compute[75463]: No targets found.
Nov 03 17:42:20 user nova-compute[75463]: iSNS:
Nov 03 17:42:20 user nova-compute[75463]: No targets found.
Nov 03 17:42:20 user nova-compute[75463]: STATIC:
Nov 03 17:42:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:42:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:42:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:42:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:42:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:42:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:20 user nova-compute[75463]: FIRMWARE:
Nov 03 17:42:20 user nova-compute[75463]: No targets found.
Nov 03 17:42:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:42:20 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:42:20 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46eca40-99bf-4f9b-ae8a-e23e847d0a9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cf47ba-c586-4e98-b88d-83c014ab79b5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:20 user nova-compute[75463]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0142c71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d'): ({'sdi'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Removing single pathed devices sdi {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb937b-8567-40bd-ab1a-221fe7f8119a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aced09-4d11-4ae4-8b5c-790f53857bba]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flushing IO for device /dev/sdi {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcec9be-f939-40fb-87b7-211f04b27093]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153fa22-579d-4c1f-a028-9376c6fcdb3d]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] SCSI volumes sdi have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90d56e-ae72-40dc-bf23-61a8d8269867]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284b9c2-8574-4dad-8574-e23b27889233]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:42:20 user nova-compute[75463]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d399f46-684c-40a6-b976-f22d85ea938a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== disconnect_volume: return (344ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:22 user nova-compute[75463]: WARNING nova.compute.manager [req-42ac3674-bffb-4eaf-87aa-c62d8252386e req-4bcec735-a39a-4dc6-8baa-4be004c1fbd9 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state resized and task_state resize_reverting.
Nov 03 17:42:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-changed-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing instance network info cache due to event network-changed-d3a879f7-3691-4255-a20a-8341c5421d9d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] Acquiring lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] Acquired lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Refreshing network info cache for port d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:42:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updated VIF entry in instance network info cache for port d3a879f7-3691-4255-a20a-8341c5421d9d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:42:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f162449e-d526-472c-bea7-7000cfc0ccb1 req-6614c362-e65b-4863-9077-66d78e4ed762 service nova] Releasing lock "refresh_cache-9afa899d-e1d6-41df-96c6-cf6b82465c7a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'migration_context' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:24 user nova-compute[75463]: DEBUG nova.objects.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Object Instance<16c9d9b1-e7e6-480c-9f80-682f2f928f19> lazy-loaded attributes: resources,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.volume.cinder [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Update attachment failed for attachment b5296da4-3b03-4dd5-ba7b-8363b98f9f88. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self.driver.rebuild(**kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise NotImplementedError()
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] NotImplementedError
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] During handling of the above exception, another exception occurred:
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     driver_block_device.attach_block_devices(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     _log_and_attach(device)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     connection_info = volume_api.attachment_update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return method.func(obj, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return self.request(url, method, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise exceptions.from_response(resp, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.compute.utils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a) {{(pid=75463) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self.driver.rebuild(**kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise NotImplementedError()
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] NotImplementedError
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] During handling of the above exception, another exception occurred:
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     driver_block_device.attach_block_devices(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     _log_and_attach(device)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     connection_info = volume_api.attachment_update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return method.func(obj, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     return self.request(url, method, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise exceptions.from_response(resp, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] During handling of the above exception, another exception occurred:
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     yield
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._do_rebuild_instance_with_claim(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._do_rebuild_instance(
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     self._rebuild_default_impl(**kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606]     raise exception.InvalidBDM(str(ex))
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR nova.compute.manager [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] 
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.675s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:25 user nova-compute[75463]: INFO nova.compute.manager [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Swapping old allocation on dict_keys(['6300a99a-c996-4cbe-994c-ecbcd97eb045']) held by migration 965b03c2-c7fd-4f5b-a251-a9b9aebd524b for instance
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Overwriting current allocation {'allocations': {'6300a99a-c996-4cbe-994c-ecbcd97eb045': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '4cbe2dfdf2f345cc9be5ef5ee6fd8e6a', 'user_id': '48c0e15fd4d84961960a5fb8a2582200', 'consumer_generation': 1} on consumer 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:25 user nova-compute[75463]: INFO nova.compute.manager [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-6466978d-e70a-45b9-8c63-503fca07a682 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ebfaa368-3faf-4b19-bb99-73ae5c03c42a)
Nov 03 17:42:25 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquired lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:26 user nova-compute[75463]: INFO nova.compute.manager [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Terminating instance
Nov 03 17:42:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG nova.network.neutron [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Releasing lock "refresh_cache-16c9d9b1-e7e6-480c-9f80-682f2f928f19" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG os_brick.utils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b33aa71-b62b-4fdb-ae73-cdad9c20eb89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[185b3031-1a4c-4d83-8782-2e296c3f02c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[848296e4-f4ea-42cf-b903-2109df61f5ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6590134-540f-42fd-96d1-1e4bd8d2944f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-8258afd2-2a96-4a7d-a0ba-dcfa6f647881 req-af344373-d31b-45a2-81fd-9929a5cd98c3 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-c25e8a44-091d-4a41-9549-63cbab062636 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-0198053c-3592-4c73-a1f6-00cd549ad3ce req-dec8fbfe-c403-4d53-83d8-f3076b855298 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-d3a879f7-3691-4255-a20a-8341c5421d9d for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:42:27 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[28980714-aee0-4098-b9fb-04d56f86e38c]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG os_brick.utils [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-e69fa514-73f9-4019-8ea6-f5225e9322f1 req-f6504d40-833f-4298-b1bc-8cb2c6667642 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Instance destroyed successfully.
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lazy-loading 'resources' on Instance uuid 9afa899d-e1d6-41df-96c6-cf6b82465c7a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3a879f7-36, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98f4fb0d-40c3-4d48-b5b4-d4b36edfd2af) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:5f:98,bridge_name='br-int',has_traffic_filtering=True,id=d3a879f7-3691-4255-a20a-8341c5421d9d,network=Network(39f90ae8-e0d3-4f37-9760-998cb5314eae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a879f7-36')
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc25e8a44-09, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d6f4774-67b4-4f36-ba80-f3de3b72daaf) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:be:b3,bridge_name='br-int',has_traffic_filtering=True,id=c25e8a44-091d-4a41-9549-63cbab062636,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc25e8a44-09')
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf47f12a-6e, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ef1777c-b0d9-4199-9b87-8dce220e914a) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=af47f12a-6e16-4fc7-86df-3ddd25b32533,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf47f12a-6e')
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd29b835-6c, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e937d26c-f1f0-418d-92ad-32d116d37be3) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:d5:0d,bridge_name='br-int',has_traffic_filtering=True,id=dd29b835-6c18-4f99-821b-4cdb2998daf6,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd29b835-6c')
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dced9bb-d5, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e00d37b-b7fd-477b-97b3-0ed55fe2325f) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5f:d3,bridge_name='br-int',has_traffic_filtering=True,id=2dced9bb-d511-4f9a-9241-c4a1e51982e5,network=Network(ad6296fa-e9c6-4363-b26a-fe856b08b3c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dced9bb-d5')
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap113f934c-3c, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c38619e-9974-4a30-9277-14482ab73936) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-c25e8a44-091d-4a41-9549-63cbab062636 for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-af47f12a-6e16-4fc7-86df-3ddd25b32533 for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-dd29b835-6c18-4f99-821b-4cdb2998daf6 for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-6162d69e-f623-4ff2-9617-781b5ff6c2b1 req-e73a9b4d-a0a4-4153-b13e-a8f72ae902c2 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-d3a879f7-3691-4255-a20a-8341c5421d9d for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-unplugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-unplugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-99d087d9-006e-406a-aa49-ce32bb69bfff req-010475d9-d4d3-476b-93ef-a2fb1b319953 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-f5b692ca-3df7-48f3-ad72-49ab11a48d11 for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:29 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:98:96,bridge_name='br-int',has_traffic_filtering=True,id=113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113f934c-3c')
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-03T17:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2131488528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2131488528',id=25,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvL89Au/RPxBbVicRInh96+scKHX+YY/Vi/tXAbIK0WYw96It4XkHpNNe9OPn31qVp8EN0TIb+qLKpj0oYJHxrnzvN5/F0/K4d/y3WvFknVHXA6aOuhoXimB8OZ3v2L4Q==',key_name='tempest-keypair-1539229121',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b40b758742d446419064852b47964eb1',ramdisk_id='',reservation_id='r-80glqgzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-285074985',owner_user_name='tempest-TaggedBootDevicesTest-285074985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='527aff6b1a0047fa8f5dec6271ed5f5e',uuid=9afa899d-e1d6-41df-96c6-cf6b82465c7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converting VIF {"id": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "address": "fa:16:3e:77:ca:4e", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5b692ca-3d", "ovs_interfaceid": "f5b692ca-3df7-48f3-ad72-49ab11a48d11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5b692ca-3d, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc41699c-e4c7-4789-920d-21556a95ef3a) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:29 user nova-compute[75463]: INFO os_vif [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ca:4e,bridge_name='br-int',has_traffic_filtering=True,id=f5b692ca-3df7-48f3-ad72-49ab11a48d11,network=Network(69898c3a-f466-4743-be98-134e25f2d113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5b692ca-3d')
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'munHdPqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[31497238-a779-4254-bd2d-46a30e4574b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]: iSNS:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]: STATIC:
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: FIRMWARE:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:42:29 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:42:29 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a969c78-6cc2-4bf9-b11b-f0fdb5781bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[313efd73-7fe1-4d9c-9829-fed86d1977cb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c211fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294'): ({'sdh'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Removing single pathed devices sdh {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424237b-ab1f-4842-808e-e9b9c784a079]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b031c824-3d66-484c-89f9-9f9e77ebb229]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Flushing IO for device /dev/sdh {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea51067-16b1-42c0-a9af-8a2a791e3913]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd59f1-a7e2-45fd-a8ee-8537b9e46a0b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] SCSI volumes sdh have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501a70a-169d-4651-97bb-33a9cf8bb9e6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9fdac-ea35-4a53-8db0-227e0b6ffe35]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260]
Nov 03 17:42:29 user nova-compute[75463]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701067cd-9973-4a72-94a1-bed1b3b13294 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94af8a36-a94f-40cd-9935-a478025108f4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== disconnect_volume: return (389ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xRAgIFGT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c505ae-2de4-43ad-aa8a-265915f5a7b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]: iSNS:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]: STATIC:
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:42:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:29 user nova-compute[75463]: FIRMWARE:
Nov 03 17:42:29 user nova-compute[75463]: No targets found.
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:42:29 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:42:29 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ac74b-0db5-4148-a65f-6581c3b51581]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f2536-47be-474a-921f-0233bcf5de66]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 (non-flash)
Nov 03 17:42:29 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c211fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7824f1-d5bc-4d43-ba31-a2ba66727563]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d5c1a5-a995-4623-b0a2-e255f2269f26]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0268a33a-bb1b-43af-b0f5-834e85946225]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4be544-4ed7-4fe0-9724-ffbf1d153098]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2334e393-17e9-4bdd-903b-5c866a5ccf87]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[266fb0f0-d7da-4c16-a721-f9c212aa597d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260]
Nov 03 17:42:29 user nova-compute[75463]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.compute.manager [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:29 user nova-compute[75463]: WARNING nova.compute.manager [req-e60cb3d8-40fc-4f51-8466-c6e45c3bdb9d req-ef594dc2-3146-44d3-a041-087743f64d26 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 for instance with vm_state active and task_state deleting.
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0bb0a0f-02fb-4599-93a4-d8c191305a50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d73843-96ef-4160-b106-fc1d4c2e42c8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== disconnect_volume: return (376ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZxtwpVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:30 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72454e0c-d4cf-496f-8177-2123127371fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:42:30 user nova-compute[75463]: No targets found.
Nov 03 17:42:30 user nova-compute[75463]: iSNS:
Nov 03 17:42:30 user nova-compute[75463]: No targets found.
Nov 03 17:42:30 user nova-compute[75463]: STATIC:
Nov 03 17:42:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c
Nov 03 17:42:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:30 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:42:30 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:42:30 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:42:30 user nova-compute[75463]: FIRMWARE:
Nov 03 17:42:30 user nova-compute[75463]: No targets found.
Nov 03 17:42:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:42:30 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:42:30 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c9a84-c912-4a8f-8a7f-c1e7f3582986]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e1d6e-ffb0-4a86-ae53-54ef14786d13]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:30 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:30 user nova-compute[75463]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c (non-flash)
Nov 03 17:42:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec423400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c'): ({'sdg'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Removing single pathed devices sdg {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d17607-8ab2-490b-91e1-4f9f39ad3f51]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c4061-4c22-47ee-9dfc-0d9d616a2ae3]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Flushing IO for device /dev/sdg {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72182332-6f33-46f5-bde6-19e48597a58f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341ce6c-44b6-485b-96ac-ea12a460018b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] SCSI volumes sdg have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c154d98d-0be8-4cbc-99c0-76a3541039ec]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17157637-c90b-40d6-ade5-fbb56eb6e71d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260]
Nov 03 17:42:30 user nova-compute[75463]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:30 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e7a136-10bf-49c8-b445-ec936eb1b66c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c9b2d-391b-4150-b534-b2687b0579fa]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] <== disconnect_volume: return (405ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:42:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Deleting instance files /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a_del
Nov 03 17:42:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Deletion of /opt/stack/data/nova/instances/9afa899d-e1d6-41df-96c6-cf6b82465c7a_del complete
Nov 03 17:42:30 user nova-compute[75463]: INFO nova.compute.manager [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Took 4.02 seconds to destroy the instance on the hypervisor.
Nov 03 17:42:30 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:42:30 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] Acquiring lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] No waiting events found dispatching network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:31 user nova-compute[75463]: WARNING nova.compute.manager [req-423eccf9-518d-42da-8d0a-b744c61474e7 req-b7f560c0-0b9c-48ab-a92f-2290d39a5b70 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received unexpected event network-vif-plugged-2dced9bb-d511-4f9a-9241-c4a1e51982e5 for instance with vm_state active and task_state deleting.
Nov 03 17:42:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:42:32 user nova-compute[75463]: INFO nova.compute.claims [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Claim successful on node user
Nov 03 17:42:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:42:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:42:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.policy [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '939dac096b51462687e049004fe3eb77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04e2c8b44f54272b2d9e693955fc4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:42:33 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Creating image(s)
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-280f4d27-1de9-48e2-aeff-aec1b1daa75a req-491ecf65-6cef-4019-8887-a9c1b2bea511 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-deleted-f5b692ca-3df7-48f3-ad72-49ab11a48d11 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:33 user nova-compute[75463]: INFO nova.compute.manager [req-280f4d27-1de9-48e2-aeff-aec1b1daa75a req-491ecf65-6cef-4019-8887-a9c1b2bea511 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Neutron deleted interface f5b692ca-3df7-48f3-ad72-49ab11a48d11; detaching it from the instance and deleting it from the info cache
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.network.neutron [req-280f4d27-1de9-48e2-aeff-aec1b1daa75a req-491ecf65-6cef-4019-8887-a9c1b2bea511 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [{"id": "d3a879f7-3691-4255-a20a-8341c5421d9d", "address": "fa:16:3e:2e:5f:98", "network": {"id": "39f90ae8-e0d3-4f37-9760-998cb5314eae", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1013904776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a879f7-36", "ovs_interfaceid": "d3a879f7-3691-4255-a20a-8341c5421d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c25e8a44-091d-4a41-9549-63cbab062636", "address": "fa:16:3e:38:be:b3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc25e8a44-09", "ovs_interfaceid": "c25e8a44-091d-4a41-9549-63cbab062636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "address": "fa:16:3e:32:7b:26", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf47f12a-6e", "ovs_interfaceid": "af47f12a-6e16-4fc7-86df-3ddd25b32533", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "address": "fa:16:3e:e9:d5:0d", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd29b835-6c", "ovs_interfaceid": "dd29b835-6c18-4f99-821b-4cdb2998daf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "address": "fa:16:3e:65:5f:d3", "network": {"id": "ad6296fa-e9c6-4363-b26a-fe856b08b3c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1796794561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dced9bb-d5", "ovs_interfaceid": "2dced9bb-d511-4f9a-9241-c4a1e51982e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "address": "fa:16:3e:29:98:96", "network": {"id": "69898c3a-f466-4743-be98-134e25f2d113", "bridge": "br-int", "label": "tempest-device-tagging-net2-1888540738", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b40b758742d446419064852b47964eb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113f934c-3c", "ovs_interfaceid": "113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-280f4d27-1de9-48e2-aeff-aec1b1daa75a req-491ecf65-6cef-4019-8887-a9c1b2bea511 service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Detach interface failed, port_id=f5b692ca-3df7-48f3-ad72-49ab11a48d11, reason: Instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.241s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk 1073741824" returned: 0 in 0.060s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.239s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:42:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Successfully created port: ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Cannot resize image /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Ensure instance console log exists: /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:34 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:35 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Took 4.47 seconds to deallocate network for instance.
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Successfully updated port: ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing instance network info cache due to event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b85b1b5d-83ed-4fd6-a31c-fa0c5022a368 req-768c2e8d-f7b3-4c00-ad6b-688666cf43ad service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-deleted-d3a879f7-3691-4255-a20a-8341c5421d9d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b85b1b5d-83ed-4fd6-a31c-fa0c5022a368 req-768c2e8d-f7b3-4c00-ad6b-688666cf43ad service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-deleted-dd29b835-6c18-4f99-821b-4cdb2998daf6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b85b1b5d-83ed-4fd6-a31c-fa0c5022a368 req-768c2e8d-f7b3-4c00-ad6b-688666cf43ad service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-deleted-2dced9bb-d511-4f9a-9241-c4a1e51982e5 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-b85b1b5d-83ed-4fd6-a31c-fa0c5022a368 req-768c2e8d-f7b3-4c00-ad6b-688666cf43ad service nova] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Received event network-vif-deleted-113f934c-3cf8-4b5e-8eb1-c1d7ff0b1351 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance network_info: |[{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.neutron [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start _get_guest_xml network_info=[{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:42:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYv+oy6nbIM6kdblCH6XMunW+vfn/d6s7v7HOblKhWo9kBxKj/kwfKpdtI/XX4yyFKdaAp7DNmydTSp8hWhJfNomoCUr7xJi93kZ/PXnwey02EryUn1V07e5jfrVyFahA==',key_name='tempest-keypair-2136500368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_devices' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:42:35 user nova-compute[75463]:   <uuid>b8270719-4769-4860-950e-ac31e5b72954</uuid>
Nov 03 17:42:35 user nova-compute[75463]:   <name>instance-0000001d</name>
Nov 03 17:42:35 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:42:35 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:42:35 user nova-compute[75463]:   <metadata>
Nov 03 17:42:35 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:42:35 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1733119461</nova:name>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:42:35</nova:creationTime>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:42:35 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:42:35 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:owner>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:user uuid="939dac096b51462687e049004fe3eb77">tempest-AttachVolumeShelveTestJSON-2020601692-project-member</nova:user>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:project uuid="a04e2c8b44f54272b2d9e693955fc4ae">tempest-AttachVolumeShelveTestJSON-2020601692</nova:project>
Nov 03 17:42:35 user nova-compute[75463]:       </nova:owner>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:42:35 user nova-compute[75463]:       <nova:ports>
Nov 03 17:42:35 user nova-compute[75463]:         <nova:port uuid="ae712e16-12d2-412a-a07f-9ffd0704c6b3">
Nov 03 17:42:35 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:42:35 user nova-compute[75463]:         </nova:port>
Nov 03 17:42:35 user nova-compute[75463]:       </nova:ports>
Nov 03 17:42:35 user nova-compute[75463]:     </nova:instance>
Nov 03 17:42:35 user nova-compute[75463]:   </metadata>
Nov 03 17:42:35 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:42:35 user nova-compute[75463]:     <system>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="serial">b8270719-4769-4860-950e-ac31e5b72954</entry>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="uuid">b8270719-4769-4860-950e-ac31e5b72954</entry>
Nov 03 17:42:35 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:42:35 user nova-compute[75463]:     </system>
Nov 03 17:42:35 user nova-compute[75463]:   </sysinfo>
Nov 03 17:42:35 user nova-compute[75463]:   <os>
Nov 03 17:42:35 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:42:35 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:42:35 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:42:35 user nova-compute[75463]:   </os>
Nov 03 17:42:35 user nova-compute[75463]:   <features>
Nov 03 17:42:35 user nova-compute[75463]:     <acpi/>
Nov 03 17:42:35 user nova-compute[75463]:     <apic/>
Nov 03 17:42:35 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:42:35 user nova-compute[75463]:   </features>
Nov 03 17:42:35 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:42:35 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:42:35 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:42:35 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:42:35 user nova-compute[75463]:   </clock>
Nov 03 17:42:35 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:42:35 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:42:35 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:42:35 user nova-compute[75463]:   </cpu>
Nov 03 17:42:35 user nova-compute[75463]:   <devices>
Nov 03 17:42:35 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:42:35 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:42:35 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk"/>
Nov 03 17:42:35 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:42:35 user nova-compute[75463]:     </disk>
Nov 03 17:42:35 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:42:35 user nova-compute[75463]:       <mac address="fa:16:3e:0a:72:d4"/>
Nov 03 17:42:35 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:42:35 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:42:35 user nova-compute[75463]:       <target dev="tapae712e16-12"/>
Nov 03 17:42:35 user nova-compute[75463]:     </interface>
Nov 03 17:42:35 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:42:35 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/console.log" append="off"/>
Nov 03 17:42:35 user nova-compute[75463]:     </serial>
Nov 03 17:42:35 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:42:35 user nova-compute[75463]:     <video>
Nov 03 17:42:35 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:42:35 user nova-compute[75463]:     </video>
Nov 03 17:42:35 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:42:35 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:42:35 user nova-compute[75463]:     </rng>
Nov 03 17:42:35 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:42:35 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:42:35 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:42:35 user nova-compute[75463]:     </memballoon>
Nov 03 17:42:35 user nova-compute[75463]:   </devices>
Nov 03 17:42:35 user nova-compute[75463]: </domain>
Nov 03 17:42:35 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYv+oy6nbIM6kdblCH6XMunW+vfn/d6s7v7HOblKhWo9kBxKj/kwfKpdtI/XX4yyFKdaAp7DNmydTSp8hWhJfNomoCUr7xJi93kZ/PXnwey02EryUn1V07e5jfrVyFahA==',key_name='tempest-keypair-2136500368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG os_vif [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd52d24b-1503-54b0-a955-d9f6a610a066', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae712e16-12, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae712e16-12, col_values=(('qos', UUID('52d9e6b4-846c-4355-a251-e0a6c75852ec')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae712e16-12, col_values=(('external_ids', {'iface-id': 'ae712e16-12d2-412a-a07f-9ffd0704c6b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:72:d4', 'vm-uuid': 'b8270719-4769-4860-950e-ac31e5b72954'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:35 user nova-compute[75463]: INFO os_vif [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12')
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:42:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No VIF found with MAC fa:16:3e:0a:72:d4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:42:36 user nova-compute[75463]: DEBUG nova.network.neutron [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updated VIF entry in instance network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:42:36 user nova-compute[75463]: DEBUG nova.network.neutron [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b3e1dd45-df67-4716-9cad-2c898d9d72e5 req-2af67b5e-343c-4d47-9641-ce9631bead18 service nova] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:37 user nova-compute[75463]: WARNING nova.compute.manager [req-747f0b9b-46b0-4ade-b82a-bd21210e44bd req-321ae552-3aaa-491a-b073-31484fe03e20 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state building and task_state spawning.
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:38 user nova-compute[75463]: INFO nova.compute.manager [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] [instance: 9afa899d-e1d6-41df-96c6-cf6b82465c7a] Took 3.46 seconds to detach 3 volumes for instance.
Nov 03 17:42:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:38 user nova-compute[75463]: ERROR nova.volume.cinder [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Update attachment failed for attachment 6dc3df43-07d1-4a9b-961e-85321a400011. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c)
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Failed to attach 4dcbb020-1412-456f-8e93-c78260bec37f at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Traceback (most recent call last):
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     connection_info = volume_api.attachment_update(
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     return method.func(obj, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     return self.request(url, method, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a]     raise exceptions.from_response(resp, body)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c)
Nov 03 17:42:39 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] 
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.692s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:39 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Deleted allocations for instance 9afa899d-e1d6-41df-96c6-cf6b82465c7a
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.517s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c80255b7-a5e7-4152-bd50-71069f342675 tempest-TaggedBootDevicesTest-285074985 tempest-TaggedBootDevicesTest-285074985-project-member] Lock "9afa899d-e1d6-41df-96c6-cf6b82465c7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.881s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-e79ed669-a14f-4e8e-8136-be78b61bde00 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b33bc3dd-c4de-44e9-8adf-91e3ea33a64c)
Nov 03 17:42:39 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:39 user nova-compute[75463]: WARNING nova.compute.manager [req-f3be7224-0379-40e2-9035-3ba4ca8f16e5 req-78d6b926-21d6-4cbb-a8f5-7710fd7aa832 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state building and task_state spawning.
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:42:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance spawned successfully.
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:42:40 user nova-compute[75463]: INFO nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 03 17:42:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:42:40 user nova-compute[75463]: INFO nova.compute.manager [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Took 8.03 seconds to build instance.
Nov 03 17:42:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3b69158-48a5-413d-bc2e-3b25cf3fbc22 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.156s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:47 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Starting finish_revert_migration {{(pid=75463) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start _get_guest_xml network_info=[{"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '16c9d9b1-e7e6-480c-9f80-682f2f928f19', 'attached_at': '2023-11-03T17:42:53.000000', 'detached_at': '', 'volume_id': 'a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'serial': 'a6e0dbb5-d0bd-4266-b3b9-658875f3b74d'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'a030b03d-e299-4437-96b3-4e48b88e4114', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:42:53 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:53 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.objects.instance [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:42:53 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:53 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:42:53 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d5679f-8b2a-4882-ba89-1eac7394509a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:42:53 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce05b31-8101-423b-a9d0-06326e1aae5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d] added
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ed252-caed-4732-8502-96d194666c56]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712cec5-2229-4e51-9f0f-26a2e920a619]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQyszkO" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63098045-abd7-44eb-bd4c-4d28698a2d54]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoQyszkO'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc6ab9-a5ed-4d0b-a3e5-9c9318462ef1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf31d293-29a4-4ee4-ab22-a579ac9cab37]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55b1d8-db6c-49b7-95b0-c1b30617c631]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:42:53 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6127ee-897d-43ce-ad60-7ff60c9bceab]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d36acf-c674-4e8a-9d39-53f3aff1d65b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:53 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:42:53 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:42:53 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdac63a-53ee-4206-84bb-cdeff326fa76]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:42:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739346162646662', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:42:54 user nova-compute[75463]:   <uuid>16c9d9b1-e7e6-480c-9f80-682f2f928f19</uuid>
Nov 03 17:42:54 user nova-compute[75463]:   <name>instance-00000014</name>
Nov 03 17:42:54 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:42:54 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:42:54 user nova-compute[75463]:   <metadata>
Nov 03 17:42:54 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:42:54 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherB-server-510344882</nova:name>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:42:53</nova:creationTime>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:42:54 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:42:54 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:owner>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:user uuid="48c0e15fd4d84961960a5fb8a2582200">tempest-ServerActionsTestOtherB-82187790-project-member</nova:user>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:project uuid="4cbe2dfdf2f345cc9be5ef5ee6fd8e6a">tempest-ServerActionsTestOtherB-82187790</nova:project>
Nov 03 17:42:54 user nova-compute[75463]:       </nova:owner>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:42:54 user nova-compute[75463]:       <nova:ports>
Nov 03 17:42:54 user nova-compute[75463]:         <nova:port uuid="9caf690a-54b9-4d7e-a4fe-5f340846ee29">
Nov 03 17:42:54 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:42:54 user nova-compute[75463]:         </nova:port>
Nov 03 17:42:54 user nova-compute[75463]:       </nova:ports>
Nov 03 17:42:54 user nova-compute[75463]:     </nova:instance>
Nov 03 17:42:54 user nova-compute[75463]:   </metadata>
Nov 03 17:42:54 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:42:54 user nova-compute[75463]:     <system>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="serial">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="uuid">16c9d9b1-e7e6-480c-9f80-682f2f928f19</entry>
Nov 03 17:42:54 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:42:54 user nova-compute[75463]:     </system>
Nov 03 17:42:54 user nova-compute[75463]:   </sysinfo>
Nov 03 17:42:54 user nova-compute[75463]:   <os>
Nov 03 17:42:54 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:42:54 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:42:54 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:42:54 user nova-compute[75463]:   </os>
Nov 03 17:42:54 user nova-compute[75463]:   <features>
Nov 03 17:42:54 user nova-compute[75463]:     <acpi/>
Nov 03 17:42:54 user nova-compute[75463]:     <apic/>
Nov 03 17:42:54 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:42:54 user nova-compute[75463]:   </features>
Nov 03 17:42:54 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:42:54 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:42:54 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:42:54 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:42:54 user nova-compute[75463]:   </clock>
Nov 03 17:42:54 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:42:54 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:42:54 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:42:54 user nova-compute[75463]:   </cpu>
Nov 03 17:42:54 user nova-compute[75463]:   <devices>
Nov 03 17:42:54 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:42:54 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:42:54 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk"/>
Nov 03 17:42:54 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:42:54 user nova-compute[75463]:     </disk>
Nov 03 17:42:54 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:42:54 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:42:54 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:42:54 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 17:42:54 user nova-compute[75463]:       <serial>a6e0dbb5-d0bd-4266-b3b9-658875f3b74d</serial>
Nov 03 17:42:54 user nova-compute[75463]:     </disk>
Nov 03 17:42:54 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:42:54 user nova-compute[75463]:       <mac address="fa:16:3e:1c:b3:b4"/>
Nov 03 17:42:54 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:42:54 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:42:54 user nova-compute[75463]:       <target dev="tap9caf690a-54"/>
Nov 03 17:42:54 user nova-compute[75463]:     </interface>
Nov 03 17:42:54 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:42:54 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/console.log" append="off"/>
Nov 03 17:42:54 user nova-compute[75463]:     </serial>
Nov 03 17:42:54 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:42:54 user nova-compute[75463]:     <video>
Nov 03 17:42:54 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:42:54 user nova-compute[75463]:     </video>
Nov 03 17:42:54 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:42:54 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:42:54 user nova-compute[75463]:     </rng>
Nov 03 17:42:54 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:42:54 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:42:54 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:42:54 user nova-compute[75463]:     </memballoon>
Nov 03 17:42:54 user nova-compute[75463]:   </devices>
Nov 03 17:42:54 user nova-compute[75463]: </domain>
Nov 03 17:42:54 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG os_vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dceeae0-b6eb-5ad6-a55c-5ecedc58987d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9caf690a-54, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9caf690a-54, col_values=(('qos', UUID('5dc2c1bf-7d16-4f81-bd7c-649f7d7cbf9d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9caf690a-54, col_values=(('external_ids', {'iface-id': '9caf690a-54b9-4d7e-a4fe-5f340846ee29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b3:b4', 'vm-uuid': '16c9d9b1-e7e6-480c-9f80-682f2f928f19'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:42:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:54 user nova-compute[75463]: INFO os_vif [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:42:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:42:55 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 4bae3d43-2efe-474a-b57c-311b090b7ba1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [{"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-4bae3d43-2efe-474a-b57c-311b090b7ba1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:56 user nova-compute[75463]: WARNING nova.compute.manager [req-08be105e-879f-414f-92d7-b438e2978c21 req-85573e28-81b3-4117-93a4-34b4b82753e0 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state resized and task_state resize_reverting.
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:42:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance running successfully.
Nov 03 17:42:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] finish_revert_migration finished successfully. {{(pid=75463) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:42:58 user nova-compute[75463]: WARNING nova.compute.manager [req-bd285140-6a19-4467-aacd-ad99ce56d9aa req-40df02b7-c976-473d-a33e-80550c4ecd45 service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state resized and task_state resize_reverting.
Nov 03 17:42:58 user nova-compute[75463]: INFO nova.compute.manager [None req-76df2ec5-920f-482d-b57f-738b84fb97f6 tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance to original state: 'active'
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:42:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:42:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:01 user nova-compute[75463]: INFO nova.compute.manager [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Terminating instance
Nov 03 17:43:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-unplugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] No waiting events found dispatching network-vif-unplugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-df605318-f449-4c7d-bdc0-013ad6994d88 req-f8f45d99-2dcd-4ef4-986b-dbf2474d287c service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-unplugged-ab4155fb-62db-4d00-91a3-ad414800259e for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Instance destroyed successfully.
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'resources' on Instance uuid 263ef766-2fbd-4277-b464-2b654a5029ee {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1421658913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1421658913',id=14,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-lajy5udt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:34:44Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=263ef766-2fbd-4277-b464-2b654a5029ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "ab4155fb-62db-4d00-91a3-ad414800259e", "address": "fa:16:3e:5f:cc:17", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab4155fb-62", "ovs_interfaceid": "ab4155fb-62db-4d00-91a3-ad414800259e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG os_vif [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab4155fb-62, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ee71f1e-dddb-4a76-87fe-3c9a4e5a6c4b) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: INFO os_vif [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cc:17,bridge_name='br-int',has_traffic_filtering=True,id=ab4155fb-62db-4d00-91a3-ad414800259e,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab4155fb-62')
Nov 03 17:43:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Deleting instance files /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee_del
Nov 03 17:43:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Deletion of /opt/stack/data/nova/instances/263ef766-2fbd-4277-b464-2b654a5029ee_del complete
Nov 03 17:43:02 user nova-compute[75463]: INFO nova.compute.manager [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:43:02 user nova-compute[75463]: INFO nova.compute.claims [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Claim successful on node user
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:02 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:03 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Took 0.62 seconds to deallocate network for instance.
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.482s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] Acquiring lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] Lock "263ef766-2fbd-4277-b464-2b654a5029ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] No waiting events found dispatching network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:03 user nova-compute[75463]: WARNING nova.compute.manager [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received unexpected event network-vif-plugged-ab4155fb-62db-4d00-91a3-ad414800259e for instance with vm_state deleted and task_state None.
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-e9ab66de-5852-44f2-a863-265fc02bdd0c req-5862369d-5481-465f-afcc-a3c6acdcf2e1 service nova] [instance: 263ef766-2fbd-4277-b464-2b654a5029ee] Received event network-vif-deleted-ab4155fb-62db-4d00-91a3-ad414800259e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:43:03 user nova-compute[75463]: INFO nova.virt.block_device [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Booting with volume ae509fc3-4680-415d-82ec-b60dd5bdacff at /dev/vda
Nov 03 17:43:03 user nova-compute[75463]: DEBUG nova.policy [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:43:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.utils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:43:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=25.030277252197266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efd21a-06fb-41d9-bf64-89091d208247]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726e8cb-0450-4eb4-8e42-c36fe2c84f50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c9345a-3236-4e8a-93ec-555a5b9831f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cf907-2516-4912-affe-4722d76d4914]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:43:04 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c78518-98da-4324-a175-6fea02d1c0e2]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG os_brick.utils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updating existing volume attachment record: f818f05c-7474-4f85-8cd5-b4d69f6b6049 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.063s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.304s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:04 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Deleted allocations for instance 263ef766-2fbd-4277-b464-2b654a5029ee
Nov 03 17:43:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-61e5447f-a4ec-42c2-ae1f-a7bba9b3045f tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "263ef766-2fbd-4277-b464-2b654a5029ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.519s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4bae3d43-2efe-474a-b57c-311b090b7ba1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 83aae736-2183-4d61-a81b-607ac62688cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b8270719-4769-4860-950e-ac31e5b72954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e5be1a8a-4c63-4192-aa6a-d449df611658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:43:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Successfully created port: d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Successfully updated port: d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-changed-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Refreshing instance network info cache due to event network-changed-d1cb5287-97e2-4902-bf33-28f6eec5eb2e. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] Acquiring lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updating instance_info_cache with network_info: [{"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Instance network_info: |[{"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] Acquired lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG nova.network.neutron [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Refreshing network info cache for port d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG nova.network.neutron [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updated VIF entry in instance network info cache for port d1cb5287-97e2-4902-bf33-28f6eec5eb2e. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG nova.network.neutron [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updating instance_info_cache with network_info: [{"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7c0901e7-b3f3-4376-bcc7-d23e020847ed req-e1a793e6-b45e-45a1-a735-8652cd3f3f95 service nova] Releasing lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:43:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Creating image(s)
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Ensure instance console log exists: /opt/stack/data/nova/instances/e5be1a8a-4c63-4192-aa6a-d449df611658/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Start _get_guest_xml network_info=[{"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsRtmdJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5be1a8a-4c63-4192-aa6a-d449df611658', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae509fc3-4680-415d-82ec-b60dd5bdacff', 'serial': 'ae509fc3-4680-415d-82ec-b60dd5bdacff'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'f818f05c-7474-4f85-8cd5-b4d69f6b6049', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:43:29 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:43:29 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsRtmdJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:43:29 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:43:29 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:43:29 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72781aa9-89a7-45b5-a08b-63dc8d9e4af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:43:29 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa1762-3900-4104-94d6-916c03baf23c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff] added
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80373a15-7de7-4b2d-ba84-0b2027e09b72]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cac26e-4d83-4ad6-bca1-1e4fa769379c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsRtmdJW {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsRtmdJW" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce289f-085e-430d-84b9-369bc4454fcd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsRtmdJW'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c508c40-e90a-42e1-967a-14d23991c98a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e12e0b0-6b85-4e40-9a5c-9c1f98f67a2f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a85d1-77b8-43ee-9564-608f16b6530f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260]
Nov 03 17:43:29 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260] successful.
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef732d1-6212-4fc1-8340-ec921afab708]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b87620-4b4b-4b94-a4fa-3dacb4c77b27]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:43:29 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:43:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a86af-67ba-46d0-8646-7cc8a08ebd9f]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:43:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsRtmdJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23363353865626362', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363353865626362', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-608297163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-608297163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-608297163',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXLm+9Kzph4TLt/c+Su4sl1Ew4go8CZNzuVTIEtKAQfF1Z74GZTWEeAu6R8Rf8O1Rql52S7hj/KSP0rWYL2vwiZlYW35/2Yslv9JB+x6G9loBiDrz9/Pns1Wj7nmofxRQ==',key_name='tempest-keypair-30668514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-gq2sgvfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=e5be1a8a-4c63-4192-aa6a-d449df611658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'pci_devices' on Instance uuid e5be1a8a-4c63-4192-aa6a-d449df611658 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:43:30 user nova-compute[75463]:   <uuid>e5be1a8a-4c63-4192-aa6a-d449df611658</uuid>
Nov 03 17:43:30 user nova-compute[75463]:   <name>instance-0000001e</name>
Nov 03 17:43:30 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:43:30 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:43:30 user nova-compute[75463]:   <metadata>
Nov 03 17:43:30 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:43:30 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:43:30 user nova-compute[75463]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-608297163</nova:name>
Nov 03 17:43:30 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:43:29</nova:creationTime>
Nov 03 17:43:30 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:43:30 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:43:30 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:43:30 user nova-compute[75463]:       <nova:owner>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:user uuid="85b5595e7da047d9965cd795b2e6a83b">tempest-TestVolumeBootPattern-79691840-project-member</nova:user>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:project uuid="88d74abcd4a349ab96ba0f188542d61c">tempest-TestVolumeBootPattern-79691840</nova:project>
Nov 03 17:43:30 user nova-compute[75463]:       </nova:owner>
Nov 03 17:43:30 user nova-compute[75463]:       <nova:ports>
Nov 03 17:43:30 user nova-compute[75463]:         <nova:port uuid="d1cb5287-97e2-4902-bf33-28f6eec5eb2e">
Nov 03 17:43:30 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:43:30 user nova-compute[75463]:         </nova:port>
Nov 03 17:43:30 user nova-compute[75463]:       </nova:ports>
Nov 03 17:43:30 user nova-compute[75463]:     </nova:instance>
Nov 03 17:43:30 user nova-compute[75463]:   </metadata>
Nov 03 17:43:30 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:43:30 user nova-compute[75463]:     <system>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="serial">e5be1a8a-4c63-4192-aa6a-d449df611658</entry>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="uuid">e5be1a8a-4c63-4192-aa6a-d449df611658</entry>
Nov 03 17:43:30 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:43:30 user nova-compute[75463]:     </system>
Nov 03 17:43:30 user nova-compute[75463]:   </sysinfo>
Nov 03 17:43:30 user nova-compute[75463]:   <os>
Nov 03 17:43:30 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:43:30 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:43:30 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:43:30 user nova-compute[75463]:   </os>
Nov 03 17:43:30 user nova-compute[75463]:   <features>
Nov 03 17:43:30 user nova-compute[75463]:     <acpi/>
Nov 03 17:43:30 user nova-compute[75463]:     <apic/>
Nov 03 17:43:30 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:43:30 user nova-compute[75463]:   </features>
Nov 03 17:43:30 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:43:30 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:43:30 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:43:30 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:43:30 user nova-compute[75463]:   </clock>
Nov 03 17:43:30 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:43:30 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:43:30 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:43:30 user nova-compute[75463]:   </cpu>
Nov 03 17:43:30 user nova-compute[75463]:   <devices>
Nov 03 17:43:30 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:43:30 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:43:30 user nova-compute[75463]:       <source dev="/dev/sdc"/>
Nov 03 17:43:30 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:43:30 user nova-compute[75463]:       <serial>ae509fc3-4680-415d-82ec-b60dd5bdacff</serial>
Nov 03 17:43:30 user nova-compute[75463]:     </disk>
Nov 03 17:43:30 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:43:30 user nova-compute[75463]:       <mac address="fa:16:3e:08:b1:fa"/>
Nov 03 17:43:30 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:43:30 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:43:30 user nova-compute[75463]:       <target dev="tapd1cb5287-97"/>
Nov 03 17:43:30 user nova-compute[75463]:     </interface>
Nov 03 17:43:30 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:43:30 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/e5be1a8a-4c63-4192-aa6a-d449df611658/console.log" append="off"/>
Nov 03 17:43:30 user nova-compute[75463]:     </serial>
Nov 03 17:43:30 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:43:30 user nova-compute[75463]:     <video>
Nov 03 17:43:30 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:43:30 user nova-compute[75463]:     </video>
Nov 03 17:43:30 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:43:30 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:43:30 user nova-compute[75463]:     </rng>
Nov 03 17:43:30 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:43:30 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:43:30 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:43:30 user nova-compute[75463]:     </memballoon>
Nov 03 17:43:30 user nova-compute[75463]:   </devices>
Nov 03 17:43:30 user nova-compute[75463]: </domain>
Nov 03 17:43:30 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-608297163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-608297163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-608297163',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXLm+9Kzph4TLt/c+Su4sl1Ew4go8CZNzuVTIEtKAQfF1Z74GZTWEeAu6R8Rf8O1Rql52S7hj/KSP0rWYL2vwiZlYW35/2Yslv9JB+x6G9loBiDrz9/Pns1Wj7nmofxRQ==',key_name='tempest-keypair-30668514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-gq2sgvfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=e5be1a8a-4c63-4192-aa6a-d449df611658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG os_vif [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e426de9f-f10b-5313-a04b-b00600c3d802', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cb5287-97, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1cb5287-97, col_values=(('qos', UUID('4c81335d-4c2b-4da8-966f-65583006a97d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1cb5287-97, col_values=(('external_ids', {'iface-id': 'd1cb5287-97e2-4902-bf33-28f6eec5eb2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:b1:fa', 'vm-uuid': 'e5be1a8a-4c63-4192-aa6a-d449df611658'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:30 user nova-compute[75463]: INFO os_vif [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97')
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:43:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No VIF found with MAC fa:16:3e:08:b1:fa, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:43:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] No waiting events found dispatching network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:32 user nova-compute[75463]: WARNING nova.compute.manager [req-e19c6d32-9a5b-458b-9159-455bbedf7b04 req-6e925231-2941-4ea2-8907-ef5e647f4f4e service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received unexpected event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e for instance with vm_state building and task_state spawning.
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] No waiting events found dispatching network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:34 user nova-compute[75463]: WARNING nova.compute.manager [req-f6cc0eeb-bb4a-405d-b2ad-f8460f816b9c req-5ece6c78-cda0-4176-9929-bed74b2f97eb service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received unexpected event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e for instance with vm_state building and task_state spawning.
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:43:34 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Instance spawned successfully.
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:43:34 user nova-compute[75463]: INFO nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 03 17:43:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:43:34 user nova-compute[75463]: INFO nova.compute.manager [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Took 31.95 seconds to build instance.
Nov 03 17:43:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2b2c81e9-cca7-43f9-af93-ee06a57b2c48 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.087s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing instance network info cache due to event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:43 user nova-compute[75463]: INFO nova.compute.manager [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Detaching volume aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updated VIF entry in instance network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:43 user nova-compute[75463]: INFO nova.virt.block_device [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Attempting to driver detach volume aa6abb99-7338-4ca5-9d86-5791f17505ad from mountpoint /dev/vdb
Nov 03 17:43:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-96a5dd3a-fcdf-401f-aca1-9d2e9fc78c15 req-9a0b6ab7-448a-4248-a6cf-6063018c8c92 service nova] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Attempting to detach device vdb from instance 6110a836-782f-4437-8970-dab2de7b0159 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:43:43 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:43:43 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:43:43 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:43:43 user nova-compute[75463]:   <serial>aa6abb99-7338-4ca5-9d86-5791f17505ad</serial>
Nov 03 17:43:43 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:43:43 user nova-compute[75463]: </disk>
Nov 03 17:43:43 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:43:43 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully detached device vdb from instance 6110a836-782f-4437-8970-dab2de7b0159 from the persistent domain config.
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6110a836-782f-4437-8970-dab2de7b0159 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:43:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:43:43 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:43:43 user nova-compute[75463]:   <source dev="/dev/sdf"/>
Nov 03 17:43:43 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:43:43 user nova-compute[75463]:   <serial>aa6abb99-7338-4ca5-9d86-5791f17505ad</serial>
Nov 03 17:43:43 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:43:43 user nova-compute[75463]: </disk>
Nov 03 17:43:43 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:43:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing instance network info cache due to event network-changed-86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] Acquiring lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] Acquired lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Refreshing network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updated VIF entry in instance network info cache for port 86816a37-ae7e-4391-825d-88f2c37cd0ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [{"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1dbe400d-1bfb-4847-9a7d-60a9bbc8e47f req-adb6a442-e6ee-4b75-9274-1e9b75eeda9c service nova] Releasing lock "refresh_cache-6110a836-782f-4437-8970-dab2de7b0159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-changed-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Refreshing instance network info cache due to event network-changed-94333704-e017-45ce-9ae2-4e72f7606a68. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] Acquiring lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] Acquired lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Refreshing network info cache for port 94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updated VIF entry in instance network info cache for port 94333704-e017-45ce-9ae2-4e72f7606a68. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updating instance_info_cache with network_info: [{"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2f83e1b0-0979-448b-9e18-0db184d04df0 req-6ee31331-09ff-4ed5-b264-8555d0e1d289 service nova] Releasing lock "refresh_cache-83aae736-2183-4d61-a81b-607ac62688cb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:52 user nova-compute[75463]: INFO nova.compute.manager [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Terminating instance
Nov 03 17:43:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-unplugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] No waiting events found dispatching network-vif-unplugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-e7fa8a0d-ee2b-4d4b-8029-bb041c683ed5 req-68a8d864-93d7-4f11-b244-51aefa4b2ca1 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-unplugged-391382d2-159d-488b-b035-5435c0de9b94 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:43:52 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Instance destroyed successfully.
Nov 03 17:43:52 user nova-compute[75463]: DEBUG nova.objects.instance [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lazy-loading 'resources' on Instance uuid 4bae3d43-2efe-474a-b57c-311b090b7ba1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1935548463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1935548463',id=2,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:29:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b9a3c05c7147b88d7814833b87d157',ramdisk_id='',reservation_id='r-jpkl0udj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:30:52Z,user_data=None,user_id='bd5c6f094b0c423ea22b458b0beecb15',uuid=4bae3d43-2efe-474a-b57c-311b090b7ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converting VIF {"id": "391382d2-159d-488b-b035-5435c0de9b94", "address": "fa:16:3e:d0:b4:24", "network": {"id": "9b621347-bcc7-4eb9-bf74-ddfb22baba3a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1935682824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b9a3c05c7147b88d7814833b87d157", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391382d2-15", "ovs_interfaceid": "391382d2-159d-488b-b035-5435c0de9b94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_vif [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391382d2-15, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd9607fe-0fbd-46a4-8420-07fe704dc379) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:43:53 user nova-compute[75463]: INFO os_vif [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:24,bridge_name='br-int',has_traffic_filtering=True,id=391382d2-159d-488b-b035-5435c0de9b94,network=Network(9b621347-bcc7-4eb9-bf74-ddfb22baba3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391382d2-15')
Nov 03 17:43:53 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Deleting instance files /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1_del
Nov 03 17:43:53 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Deletion of /opt/stack/data/nova/instances/4bae3d43-2efe-474a-b57c-311b090b7ba1_del complete
Nov 03 17:43:53 user nova-compute[75463]: INFO nova.compute.manager [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.objects.instance [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:53 user nova-compute[75463]: INFO nova.compute.manager [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Attaching volume 49791104-83cf-48f4-af77-0141aa09e6d2 to /dev/vdb
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc384f41-205d-4162-a0ff-995f3392b3e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[592404f5-d8fe-429e-b09e-ddc1508e7bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a4173-7dd2-473a-9dcd-45dabdf78caf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[643de6a1-feea-45e5-9169-9c9d726a7603]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:43:53 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c620a-8fed-45b1-a167-4fa7b44998c7]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updating existing volume attachment record: 090e4218-6ad0-42e6-8833-7931cb51cae9 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:43:53 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Took 0.75 seconds to deallocate network for instance.
Nov 03 17:43:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-712c4f31-8cca-4375-9ab0-0ce371c31fe4 req-067fbb02-1f3c-4a17-8391-a365dfc397fb service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-deleted-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:54 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Deleted allocations for instance 4bae3d43-2efe-474a-b57c-311b090b7ba1
Nov 03 17:43:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-158a78ba-eba0-4f64-acd4-2543c18e91ce tempest-ServerBootFromVolumeStableRescueTest-2042988048 tempest-ServerBootFromVolumeStableRescueTest-2042988048-project-member] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] Acquiring lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] Lock "4bae3d43-2efe-474a-b57c-311b090b7ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] No waiting events found dispatching network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:43:54 user nova-compute[75463]: WARNING nova.compute.manager [req-651d3b79-de35-4e6e-af3c-1b558e748d1b req-4ca76d9e-d9b2-4e8a-b9d3-e1b552cc6283 service nova] [instance: 4bae3d43-2efe-474a-b57c-311b090b7ba1] Received unexpected event network-vif-plugged-391382d2-159d-488b-b035-5435c0de9b94 for instance with vm_state deleted and task_state None.
Nov 03 17:43:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:43:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:43:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [{"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:43:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c79148db-7d6f-4a58-8e75-ead5b154c335" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:43:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:43:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:43:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.217361450195312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 6110a836-782f-4437-8970-dab2de7b0159 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 83aae736-2183-4d61-a81b-607ac62688cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b8270719-4769-4860-950e-ac31e5b72954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e5be1a8a-4c63-4192-aa6a-d449df611658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:44:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6110a836-782f-4437-8970-dab2de7b0159 is timed out.
Nov 03 17:44:04 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully detached device vdb from instance 6110a836-782f-4437-8970-dab2de7b0159 from the live domain config.
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCnrbDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:44:04 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3effe4a6-9fe0-4f47-82a7-226a25951904]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:44:04 user nova-compute[75463]: No targets found.
Nov 03 17:44:04 user nova-compute[75463]: iSNS:
Nov 03 17:44:04 user nova-compute[75463]: No targets found.
Nov 03 17:44:04 user nova-compute[75463]: STATIC:
Nov 03 17:44:04 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:44:04 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:04 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:04 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff
Nov 03 17:44:04 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:04 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:04 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad
Nov 03 17:44:04 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:04 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:04 user nova-compute[75463]: FIRMWARE:
Nov 03 17:44:04 user nova-compute[75463]: No targets found.
Nov 03 17:44:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:44:04 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:44:04 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[60870e67-15cf-41f0-b042-55dc75f9f4cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce5ddc-7913-4663-9362-9991cf7042fe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:44:04 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:04 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad (non-flash)
Nov 03 17:44:04 user nova-compute[75463]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:04 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec59f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad'): ({'sdf'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Removing single pathed devices sdf {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f154df1-3566-46b5-9978-0271e1f32ce0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c23247-e1c6-45f1-b761-c8eed21ab62e]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Flushing IO for device /dev/sdf {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a83aed-f7d5-4525-9847-04e0ee4db602]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daba98b-8014-44b4-8287-bf0c26b22489]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] SCSI volumes sdf have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.109s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826e139-e535-40eb-b49c-229fa6776916]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa1536-867e-45ac-ac90-e87aa773e2b7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260]
Nov 03 17:44:04 user nova-compute[75463]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad, portal: 172.16.0.220,3260] successful.
Nov 03 17:44:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6abb99-7338-4ca5-9d86-5791f17505ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9753cbce-eb4c-433d-9e4b-9a6603d3b769]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] <== disconnect_volume: return (428ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:44:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'flavor' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a31f2e3-5804-4b8d-a3bd-1fe52605ff1e tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.311s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:44:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:44:16 user nova-compute[75463]: INFO nova.compute.claims [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Claim successful on node user
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:44:16 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:44:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:44:17 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Creating image(s)
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "/opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "/opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "/opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.policy [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9adc4e102124fa2ad1a5e2318f7373d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9e6f3f65a64c159031d2a285ddc418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KokITeyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:44:17 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:44:17 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:44:17 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8f1ad9-caf2-40d8-960d-4c468f0efa11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:44:17 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e212fac-bff1-48fa-a903-3be9b3834bca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2] added
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.168s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d979c-4741-4300-8901-e31667214732]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2a664-df6d-4c1b-a0a5-51ccacc557b6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KokITeyD {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KokITeyD" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89a1e1-2e55-42d8-b304-e1a461bf7658]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KokITeyD'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0735e9-84a1-4e7b-9ded-bbe2fad3639b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e22e6f-876d-4762-9f3f-3f90c0c08329]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d989c96-869a-4958-8311-16f389bfcffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260]
Nov 03 17:44:17 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260] successful.
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk 1073741824" returned: 0 in 0.061s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f076e0-c86a-4540-9661-3db08d744dea]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[49051b47-b01f-48bf-a895-6821abe94b1e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:17 user nova-compute[75463]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)
Nov 03 17:44:17 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5ee14-f53c-406e-94f7-2931b0df76c4]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Cannot resize image /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Ensure instance console log exists: /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Successfully created port: 2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KokITeyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23930316630643665', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930316630643665', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:44:18 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:44:18 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:44:18 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:44:18 user nova-compute[75463]:   <serial>49791104-83cf-48f4-af77-0141aa09e6d2</serial>
Nov 03 17:44:18 user nova-compute[75463]: </disk>
Nov 03 17:44:18 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Successfully updated port: 2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquired lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-changed-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Refreshing instance network info cache due to event network-changed-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] Acquiring lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Updating instance_info_cache with network_info: [{"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Releasing lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Instance network_info: |[{"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] Acquired lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.neutron [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Refreshing network info cache for port 2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Start _get_guest_xml network_info=[{"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:33:3e:41, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:44:19 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:19 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1082869292',display_name='tempest-VolumesNegativeTest-instance-1082869292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1082869292',id=31,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9e6f3f65a64c159031d2a285ddc418',ramdisk_id='',reservation_id='r-6xbyphpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2073104485',owner_user_name='tempest-VolumesNegativeTest-2073104485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:44:17Z,user_data=None,user_id='f9adc4e102124fa2ad1a5e2318f7373d',uuid=4830d50c-1d39-4d7d-9503-e35c4cce17ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converting VIF {"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lazy-loading 'pci_devices' on Instance uuid 4830d50c-1d39-4d7d-9503-e35c4cce17ef {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:44:19 user nova-compute[75463]:   <uuid>4830d50c-1d39-4d7d-9503-e35c4cce17ef</uuid>
Nov 03 17:44:19 user nova-compute[75463]:   <name>instance-0000001f</name>
Nov 03 17:44:19 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:44:19 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:44:19 user nova-compute[75463]:   <metadata>
Nov 03 17:44:19 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:44:19 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:name>tempest-VolumesNegativeTest-instance-1082869292</nova:name>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:44:19</nova:creationTime>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:44:19 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:44:19 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:owner>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:user uuid="f9adc4e102124fa2ad1a5e2318f7373d">tempest-VolumesNegativeTest-2073104485-project-member</nova:user>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:project uuid="9c9e6f3f65a64c159031d2a285ddc418">tempest-VolumesNegativeTest-2073104485</nova:project>
Nov 03 17:44:19 user nova-compute[75463]:       </nova:owner>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:44:19 user nova-compute[75463]:       <nova:ports>
Nov 03 17:44:19 user nova-compute[75463]:         <nova:port uuid="2b05f26b-eb2c-4e19-8ca4-c0f267ecc827">
Nov 03 17:44:19 user nova-compute[75463]:           <nova:ip type="fixed" address="192.168.233.79" ipVersion="4"/>
Nov 03 17:44:19 user nova-compute[75463]:         </nova:port>
Nov 03 17:44:19 user nova-compute[75463]:       </nova:ports>
Nov 03 17:44:19 user nova-compute[75463]:     </nova:instance>
Nov 03 17:44:19 user nova-compute[75463]:   </metadata>
Nov 03 17:44:19 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:44:19 user nova-compute[75463]:     <system>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="serial">4830d50c-1d39-4d7d-9503-e35c4cce17ef</entry>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="uuid">4830d50c-1d39-4d7d-9503-e35c4cce17ef</entry>
Nov 03 17:44:19 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:44:19 user nova-compute[75463]:     </system>
Nov 03 17:44:19 user nova-compute[75463]:   </sysinfo>
Nov 03 17:44:19 user nova-compute[75463]:   <os>
Nov 03 17:44:19 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:44:19 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:44:19 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:44:19 user nova-compute[75463]:   </os>
Nov 03 17:44:19 user nova-compute[75463]:   <features>
Nov 03 17:44:19 user nova-compute[75463]:     <acpi/>
Nov 03 17:44:19 user nova-compute[75463]:     <apic/>
Nov 03 17:44:19 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:44:19 user nova-compute[75463]:   </features>
Nov 03 17:44:19 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:44:19 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:44:19 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:44:19 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:44:19 user nova-compute[75463]:   </clock>
Nov 03 17:44:19 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:44:19 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:44:19 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:44:19 user nova-compute[75463]:   </cpu>
Nov 03 17:44:19 user nova-compute[75463]:   <devices>
Nov 03 17:44:19 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:44:19 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:44:19 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk"/>
Nov 03 17:44:19 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:44:19 user nova-compute[75463]:     </disk>
Nov 03 17:44:19 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:44:19 user nova-compute[75463]:       <mac address="fa:16:3e:1c:09:6e"/>
Nov 03 17:44:19 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:44:19 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:44:19 user nova-compute[75463]:       <target dev="tap2b05f26b-eb"/>
Nov 03 17:44:19 user nova-compute[75463]:     </interface>
Nov 03 17:44:19 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:44:19 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/console.log" append="off"/>
Nov 03 17:44:19 user nova-compute[75463]:     </serial>
Nov 03 17:44:19 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:44:19 user nova-compute[75463]:     <video>
Nov 03 17:44:19 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:44:19 user nova-compute[75463]:     </video>
Nov 03 17:44:19 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:44:19 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:44:19 user nova-compute[75463]:     </rng>
Nov 03 17:44:19 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:44:19 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:44:19 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:44:19 user nova-compute[75463]:     </memballoon>
Nov 03 17:44:19 user nova-compute[75463]:   </devices>
Nov 03 17:44:19 user nova-compute[75463]: </domain>
Nov 03 17:44:19 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1082869292',display_name='tempest-VolumesNegativeTest-instance-1082869292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1082869292',id=31,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9e6f3f65a64c159031d2a285ddc418',ramdisk_id='',reservation_id='r-6xbyphpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2073104485',owner_user_name='tempest-VolumesNegativeTest-2073104485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:44:17Z,user_data=None,user_id='f9adc4e102124fa2ad1a5e2318f7373d',uuid=4830d50c-1d39-4d7d-9503-e35c4cce17ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converting VIF {"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG os_vif [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '959c01e3-2af1-5846-b019-dffff46cdbd6', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b05f26b-eb, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b05f26b-eb, col_values=(('qos', UUID('7ba06646-94b8-4634-a07b-25ddecbd8fa6')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b05f26b-eb, col_values=(('external_ids', {'iface-id': '2b05f26b-eb2c-4e19-8ca4-c0f267ecc827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:09:6e', 'vm-uuid': '4830d50c-1d39-4d7d-9503-e35c4cce17ef'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:19 user nova-compute[75463]: INFO os_vif [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb')
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] No VIF found with MAC fa:16:3e:1c:09:6e, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-69436fb8-bcf0-44bf-946f-010f5341ce04 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.898s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.neutron [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Updated VIF entry in instance network info cache for port 2b05f26b-eb2c-4e19-8ca4-c0f267ecc827. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG nova.network.neutron [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Updating instance_info_cache with network_info: [{"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5e2af94-3f6f-40a4-97f4-7e29d6226856 req-090c7738-ecc8-4fd8-8287-12b5fb94ed24 service nova] Releasing lock "refresh_cache-4830d50c-1d39-4d7d-9503-e35c4cce17ef" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:20 user nova-compute[75463]: INFO nova.compute.manager [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Detaching volume 49791104-83cf-48f4-af77-0141aa09e6d2
Nov 03 17:44:20 user nova-compute[75463]: INFO nova.virt.block_device [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Attempting to driver detach volume 49791104-83cf-48f4-af77-0141aa09e6d2 from mountpoint /dev/vdb
Nov 03 17:44:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Attempting to detach device vdb from instance 83aae736-2183-4d61-a81b-607ac62688cb from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:44:20 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:44:20 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:44:20 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:44:20 user nova-compute[75463]:   <serial>49791104-83cf-48f4-af77-0141aa09e6d2</serial>
Nov 03 17:44:20 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:44:20 user nova-compute[75463]: </disk>
Nov 03 17:44:20 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:44:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 83aae736-2183-4d61-a81b-607ac62688cb from the persistent domain config.
Nov 03 17:44:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83aae736-2183-4d61-a81b-607ac62688cb from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:44:20 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:44:20 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:44:20 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:44:20 user nova-compute[75463]:   <serial>49791104-83cf-48f4-af77-0141aa09e6d2</serial>
Nov 03 17:44:20 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:44:20 user nova-compute[75463]: </disk>
Nov 03 17:44:20 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] No waiting events found dispatching network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:21 user nova-compute[75463]: WARNING nova.compute.manager [req-29aac09f-c548-424d-9f7c-37f0dbb51b42 req-8877e0b0-b0f5-486a-97df-b37500fc1e0f service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received unexpected event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 for instance with vm_state building and task_state spawning.
Nov 03 17:44:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing instance network info cache due to event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:22 user nova-compute[75463]: DEBUG nova.network.neutron [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] No waiting events found dispatching network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:23 user nova-compute[75463]: WARNING nova.compute.manager [req-079cf9bf-b648-4018-90a4-ccf7d703306c req-61906607-f46d-46fc-8252-5ab32a06f498 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received unexpected event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 for instance with vm_state building and task_state spawning.
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updated VIF entry in instance network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:44:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Instance spawned successfully.
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-31815ef1-8885-4384-9322-ccc15c3cdd0c req-b18fa0e1-f033-4e87-ba0b-8a0d4af8ecaf service nova] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:44:23 user nova-compute[75463]: INFO nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 03 17:44:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:44:23 user nova-compute[75463]: INFO nova.compute.manager [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Took 7.09 seconds to build instance.
Nov 03 17:44:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6fa7869c-0acf-4897-9487-4ece91f768e2 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.244s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:30 user nova-compute[75463]: INFO nova.compute.manager [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Shelving
Nov 03 17:44:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:30 user nova-compute[75463]: WARNING nova.compute.manager [req-9dc07f2c-33c4-414a-b87a-ff5a448f589b req-88088ff4-7c5f-46a9-8bfc-cf2e2ca531f5 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state active and task_state shelving.
Nov 03 17:44:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance destroyed successfully.
Nov 03 17:44:30 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Beginning cold snapshot process
Nov 03 17:44:31 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:44:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk /opt/stack/data/nova/instances/snapshots/tmpzidzptm6/0299a01df2db4e9a9188cb88abef435f {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk /opt/stack/data/nova/instances/snapshots/tmpzidzptm6/0299a01df2db4e9a9188cb88abef435f" returned: 0 in 1.010s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Snapshot extracted, beginning image upload
Nov 03 17:44:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:32 user nova-compute[75463]: DEBUG nova.compute.manager [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:32 user nova-compute[75463]: WARNING nova.compute.manager [req-0cd0d2a5-e8ae-4119-9716-7db18b11da2d req-7d2ad6c4-9a15-46eb-b4b9-b7b99d2eb061 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state active and task_state shelving_image_uploading.
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:34 user nova-compute[75463]: INFO nova.compute.manager [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Terminating instance
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-5faf6fbc-09a2-4c96-a258-c925e6a1dc77 req-1232d65d-0a3b-42c4-b9f6-9aa347821d75 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-unplugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Instance destroyed successfully.
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.objects.instance [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid 6110a836-782f-4437-8970-dab2de7b0159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-11196190',display_name='tempest-ServerRescueNegativeTestJSON-server-11196190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-11196190',id=23,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE73M3Ol7ADYyqS9FRTQwH0cZ7M/str/DVtrAgoXpl2KUqGATiIM0tygpgiTPdiIQpHC0u5uD1Qlb6Uyj1kiPxJXtW+glXUP7RSE6Cn5ECaHBOdGh7JVAMU7Z/SMEe7rcQ==',key_name='tempest-keypair-1281372959',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-0p5lnn5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=6110a836-782f-4437-8970-dab2de7b0159,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "address": "fa:16:3e:58:d3:fa", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86816a37-ae", "ovs_interfaceid": "86816a37-ae7e-4391-825d-88f2c37cd0ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG os_vif [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86816a37-ae, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb35b76c-808f-4ff9-993c-90e42450ed8d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:34 user nova-compute[75463]: INFO os_vif [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:d3:fa,bridge_name='br-int',has_traffic_filtering=True,id=86816a37-ae7e-4391-825d-88f2c37cd0ed,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86816a37-ae')
Nov 03 17:44:34 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Deleting instance files /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159_del
Nov 03 17:44:34 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Deletion of /opt/stack/data/nova/instances/6110a836-782f-4437-8970-dab2de7b0159_del complete
Nov 03 17:44:35 user nova-compute[75463]: INFO nova.compute.manager [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 03 17:44:35 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:44:35 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:44:35 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:44:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Snapshot image upload complete
Nov 03 17:44:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:44:35 user nova-compute[75463]: INFO nova.compute.manager [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Shelve offloading
Nov 03 17:44:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance destroyed successfully.
Nov 03 17:44:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:44:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Took 0.95 seconds to deallocate network for instance.
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Deleted allocations for instance 6110a836-782f-4437-8970-dab2de7b0159
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-38aa2aeb-f54a-441f-8ef4-997656ce6a42 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "6110a836-782f-4437-8970-dab2de7b0159" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.532s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] Acquiring lock "6110a836-782f-4437-8970-dab2de7b0159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] Lock "6110a836-782f-4437-8970-dab2de7b0159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] No waiting events found dispatching network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:44:36 user nova-compute[75463]: WARNING nova.compute.manager [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received unexpected event network-vif-plugged-86816a37-ae7e-4391-825d-88f2c37cd0ed for instance with vm_state deleted and task_state None.
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-b0ec8a53-588d-4aa7-b9ae-4c7468dd5e6c req-fd6b74ae-e9fc-486b-ab17-7516eb7c9ba5 service nova] [instance: 6110a836-782f-4437-8970-dab2de7b0159] Received event network-vif-deleted-86816a37-ae7e-4391-825d-88f2c37cd0ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance destroyed successfully.
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'resources' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing instance network info cache due to event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.network.neutron [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYv+oy6nbIM6kdblCH6XMunW+vfn/d6s7v7HOblKhWo9kBxKj/kwfKpdtI/XX4yyFKdaAp7DNmydTSp8hWhJfNomoCUr7xJi93kZ/PXnwey02EryUn1V07e5jfrVyFahA==',key_name='tempest-keypair-2136500368',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:44:35.577267',shelved_host='user',shelved_image_id='5560bb3c-d8f2-4721-b3d1-94d5f01a0212'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG os_vif [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae712e16-12, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52d9e6b4-846c-4355-a251-e0a6c75852ec) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:36 user nova-compute[75463]: INFO os_vif [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12')
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Deleting instance files /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954_del
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Deletion of /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954_del complete
Nov 03 17:44:36 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Deleted allocations for instance b8270719-4769-4860-950e-ac31e5b72954
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'numa_topology' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:36 user nova-compute[75463]: DEBUG nova.objects.base [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<b8270719-4769-4860-950e-ac31e5b72954> lazy-loaded attributes: resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updated VIF entry in instance network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapae712e16-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-365dd627-ffd0-4b21-b441-c957bd9075c6 req-33541caa-d049-4bff-9f3c-f3a42f12103d service nova] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0cf131f4-c9ef-4b49-9b81-1d5baa56e5ee tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.222s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83aae736-2183-4d61-a81b-607ac62688cb is timed out.
Nov 03 17:44:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 83aae736-2183-4d61-a81b-607ac62688cb from the live domain config.
Nov 03 17:44:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KokITeyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:44:41 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c719b8c-bdc0-48f2-9aff-b9a9b4f870e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:44:41 user nova-compute[75463]: No targets found.
Nov 03 17:44:41 user nova-compute[75463]: iSNS:
Nov 03 17:44:41 user nova-compute[75463]: No targets found.
Nov 03 17:44:41 user nova-compute[75463]: STATIC:
Nov 03 17:44:41 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2
Nov 03 17:44:41 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:41 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:41 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:44:41 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:41 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:41 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff
Nov 03 17:44:41 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:44:41 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:44:41 user nova-compute[75463]: FIRMWARE:
Nov 03 17:44:41 user nova-compute[75463]: No targets found.
Nov 03 17:44:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:44:41 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:44:41 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aee4da-444f-4a37-a456-04eab76d7852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ee24d-49a4-4a94-9a35-243e7a986936]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:41 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:41 user nova-compute[75463]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)
Nov 03 17:44:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:44:41 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:44:41 user nova-compute[75463]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 (non-flash)
Nov 03 17:44:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec2c1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37387c-8311-414c-bd6c-54db6241c6a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb696dc9-f506-4f5b-9320-e1f7fd59d5c4]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec40ac-d2d9-4266-b8a8-49466b2f9b5b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67c139a-8025-44c9-b847-abcabaded22f]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a4b470-5ad4-4ecd-be9c-804017149585]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35d5f0-576d-4f67-b83f-42e07014977b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260]
Nov 03 17:44:41 user nova-compute[75463]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2, portal: 172.16.0.220,3260] successful.
Nov 03 17:44:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49791104-83cf-48f4-af77-0141aa09e6d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[30100796-6e21-4618-8a24-98aacc335b25]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== disconnect_volume: return (335ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:44:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53723a79-26fc-4b1a-8ae0-c642a008ba88 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.071s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:46 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-changed-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Refreshing instance network info cache due to event network-changed-d1cb5287-97e2-4902-bf33-28f6eec5eb2e. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] Acquiring lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] Acquired lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Refreshing network info cache for port d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:44:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updated VIF entry in instance network info cache for port d1cb5287-97e2-4902-bf33-28f6eec5eb2e. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:44:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updating instance_info_cache with network_info: [{"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-10a290c8-f689-4154-b69d-5ca740832b7a req-16749c0e-2977-42a7-8301-07b590e0bd7b service nova] Releasing lock "refresh_cache-e5be1a8a-4c63-4192-aa6a-d449df611658" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:44:56 user nova-compute[75463]: INFO nova.compute.claims [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Claim successful on node user
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:44:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:44:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.policy [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45610cefcbb242f5a049f3fb3eaaa110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4f349c4a854f55a6f5c8a3b6003893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:44:56 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Creating image(s)
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "/opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "/opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "/opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk 1073741824" returned: 0 in 0.054s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Successfully created port: 00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Cannot resize image /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Ensure instance console log exists: /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:44:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Successfully updated port: 00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquired lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-changed-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Refreshing instance network info cache due to event network-changed-00d801dc-b4fa-4e5d-b75e-7200e0bd5465. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] Acquiring lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updating instance_info_cache with network_info: [{"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Releasing lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Instance network_info: |[{"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] Acquired lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Refreshing network info cache for port 00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Start _get_guest_xml network_info=[{"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:44:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-614403362',display_name='tempest-AttachVolumeTestJSON-server-614403362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-614403362',id=32,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo96TnEhyjB+RlBmqU7h0WZehuR1/ciRN259W0+UeZeND3EaRr9WgsE2zG8GPZS5BKCZMXeqf8V90Kn6OzeqfR/g4fP6A3n3CLIEnbwVp2c7Cxi1111ndF+83N0Q0jwg==',key_name='tempest-keypair-1447222031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-6721qp0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=1845bc31-b26e-4e39-bd20-10cf3c99128f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'pci_devices' on Instance uuid 1845bc31-b26e-4e39-bd20-10cf3c99128f {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:44:58 user nova-compute[75463]:   <uuid>1845bc31-b26e-4e39-bd20-10cf3c99128f</uuid>
Nov 03 17:44:58 user nova-compute[75463]:   <name>instance-00000020</name>
Nov 03 17:44:58 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:44:58 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:44:58 user nova-compute[75463]:   <metadata>
Nov 03 17:44:58 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:44:58 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeTestJSON-server-614403362</nova:name>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:44:58</nova:creationTime>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:44:58 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:44:58 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:owner>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:user uuid="45610cefcbb242f5a049f3fb3eaaa110">tempest-AttachVolumeTestJSON-1212926870-project-member</nova:user>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:project uuid="9d4f349c4a854f55a6f5c8a3b6003893">tempest-AttachVolumeTestJSON-1212926870</nova:project>
Nov 03 17:44:58 user nova-compute[75463]:       </nova:owner>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:44:58 user nova-compute[75463]:       <nova:ports>
Nov 03 17:44:58 user nova-compute[75463]:         <nova:port uuid="00d801dc-b4fa-4e5d-b75e-7200e0bd5465">
Nov 03 17:44:58 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 17:44:58 user nova-compute[75463]:         </nova:port>
Nov 03 17:44:58 user nova-compute[75463]:       </nova:ports>
Nov 03 17:44:58 user nova-compute[75463]:     </nova:instance>
Nov 03 17:44:58 user nova-compute[75463]:   </metadata>
Nov 03 17:44:58 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:44:58 user nova-compute[75463]:     <system>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="serial">1845bc31-b26e-4e39-bd20-10cf3c99128f</entry>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="uuid">1845bc31-b26e-4e39-bd20-10cf3c99128f</entry>
Nov 03 17:44:58 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:44:58 user nova-compute[75463]:     </system>
Nov 03 17:44:58 user nova-compute[75463]:   </sysinfo>
Nov 03 17:44:58 user nova-compute[75463]:   <os>
Nov 03 17:44:58 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:44:58 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:44:58 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:44:58 user nova-compute[75463]:   </os>
Nov 03 17:44:58 user nova-compute[75463]:   <features>
Nov 03 17:44:58 user nova-compute[75463]:     <acpi/>
Nov 03 17:44:58 user nova-compute[75463]:     <apic/>
Nov 03 17:44:58 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:44:58 user nova-compute[75463]:   </features>
Nov 03 17:44:58 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:44:58 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:44:58 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:44:58 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:44:58 user nova-compute[75463]:   </clock>
Nov 03 17:44:58 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:44:58 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:44:58 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:44:58 user nova-compute[75463]:   </cpu>
Nov 03 17:44:58 user nova-compute[75463]:   <devices>
Nov 03 17:44:58 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:44:58 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:44:58 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk"/>
Nov 03 17:44:58 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:44:58 user nova-compute[75463]:     </disk>
Nov 03 17:44:58 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:44:58 user nova-compute[75463]:       <mac address="fa:16:3e:93:6d:4b"/>
Nov 03 17:44:58 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:44:58 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:44:58 user nova-compute[75463]:       <target dev="tap00d801dc-b4"/>
Nov 03 17:44:58 user nova-compute[75463]:     </interface>
Nov 03 17:44:58 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:44:58 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/console.log" append="off"/>
Nov 03 17:44:58 user nova-compute[75463]:     </serial>
Nov 03 17:44:58 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:44:58 user nova-compute[75463]:     <video>
Nov 03 17:44:58 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:44:58 user nova-compute[75463]:     </video>
Nov 03 17:44:58 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:44:58 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:44:58 user nova-compute[75463]:     </rng>
Nov 03 17:44:58 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:44:58 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:44:58 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:44:58 user nova-compute[75463]:     </memballoon>
Nov 03 17:44:58 user nova-compute[75463]:   </devices>
Nov 03 17:44:58 user nova-compute[75463]: </domain>
Nov 03 17:44:58 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-614403362',display_name='tempest-AttachVolumeTestJSON-server-614403362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-614403362',id=32,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo96TnEhyjB+RlBmqU7h0WZehuR1/ciRN259W0+UeZeND3EaRr9WgsE2zG8GPZS5BKCZMXeqf8V90Kn6OzeqfR/g4fP6A3n3CLIEnbwVp2c7Cxi1111ndF+83N0Q0jwg==',key_name='tempest-keypair-1447222031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-6721qp0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=1845bc31-b26e-4e39-bd20-10cf3c99128f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG os_vif [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03122496-1add-57c0-aaca-91b09f8f7f1f', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00d801dc-b4, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00d801dc-b4, col_values=(('qos', UUID('6cab3422-c564-4cb2-ae5a-41fb4a613c7d')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00d801dc-b4, col_values=(('external_ids', {'iface-id': '00d801dc-b4fa-4e5d-b75e-7200e0bd5465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:6d:4b', 'vm-uuid': '1845bc31-b26e-4e39-bd20-10cf3c99128f'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:44:58 user nova-compute[75463]: INFO os_vif [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4')
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:44:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No VIF found with MAC fa:16:3e:93:6d:4b, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updated VIF entry in instance network info cache for port 00d801dc-b4fa-4e5d-b75e-7200e0bd5465. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updating instance_info_cache with network_info: [{"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6a136792-d77e-4c2d-9d04-5c984e38b50a req-1d2e0048-0fa9-47b1-9680-9f58690fe744 service nova] Releasing lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [{"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-bd9327c9-ae8e-424e-ac57-026284f57f85" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:44:59 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] No waiting events found dispatching network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:00 user nova-compute[75463]: WARNING nova.compute.manager [req-769e2b56-4e7d-448c-a5d2-537030a819cf req-378ce6e8-f998-455f-9a54-fe4b40a65f3c service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received unexpected event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 for instance with vm_state building and task_state spawning.
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:45:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Instance spawned successfully.
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] No waiting events found dispatching network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:02 user nova-compute[75463]: WARNING nova.compute.manager [req-b2c923f3-a519-4b9f-a889-bcace04055fa req-085eb76a-66b2-4878-80aa-b7f3a91da32f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received unexpected event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 for instance with vm_state building and task_state spawning.
Nov 03 17:45:02 user nova-compute[75463]: INFO nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 03 17:45:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:02 user nova-compute[75463]: INFO nova.compute.manager [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Took 6.51 seconds to build instance.
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c6b996bc-d860-4e51-a993-cf1dc6b6d2ae tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.615s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:45:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:06 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:45:06 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:45:06 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.190196990966797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:45:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance bd9327c9-ae8e-424e-ac57-026284f57f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 83aae736-2183-4d61-a81b-607ac62688cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e5be1a8a-4c63-4192-aa6a-d449df611658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4830d50c-1d39-4d7d-9503-e35c4cce17ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.801s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:45:08 user nova-compute[75463]: INFO nova.compute.claims [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Claim successful on node user
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:45:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:45:09 user nova-compute[75463]: INFO nova.virt.block_device [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Booting with volume snapshot ff4c6b63-5251-4de2-b73e-2bafab458aa9 at /dev/vda
Nov 03 17:45:09 user nova-compute[75463]: DEBUG nova.policy [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Successfully created port: 840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:10 user nova-compute[75463]: INFO nova.compute.manager [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Terminating instance
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-1a0a7b75-3a1e-424a-8fb6-27a3c30cd6ef req-2b16274a-05da-4964-8528-35354e2a020a service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-unplugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:45:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Successfully updated port: 840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-changed-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Refreshing instance network info cache due to event network-changed-840f836a-7de7-4046-b502-65be4ea2bf0f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] Acquiring lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.compute.manager [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Terminating instance
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Instance destroyed successfully.
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.objects.instance [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lazy-loading 'resources' on Instance uuid 16c9d9b1-e7e6-480c-9f80-682f2f928f19 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-510344882',display_name='tempest-ServerActionsTestOtherB-server-510344882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-510344882',id=20,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0ruAVtb7RIo/emnRcrhHQzOHZ5Ito35/EHzMQsJBYiFL0QMDwXvBwmi2ZwHIkcJd1/lHJU/OsWbfsCQisaTYklqEdNjDFLTAEOuAgraOzMdLuK7/NF2LASr1QqbdDWpg==',key_name='tempest-keypair-1896750508',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cbe2dfdf2f345cc9be5ef5ee6fd8e6a',ramdisk_id='',reservation_id='r-2pp846m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-82187790',owner_user_name='tempest-ServerActionsTestOtherB-82187790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48c0e15fd4d84961960a5fb8a2582200',uuid=16c9d9b1-e7e6-480c-9f80-682f2f928f19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converting VIF {"id": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "address": "fa:16:3e:1c:b3:b4", "network": {"id": "99f914e1-6713-4f9a-86e8-62fe75bae861", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1873021690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4cbe2dfdf2f345cc9be5ef5ee6fd8e6a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf690a-54", "ovs_interfaceid": "9caf690a-54b9-4d7e-a4fe-5f340846ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_vif [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9caf690a-54, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dc2c1bf-7d16-4f81-bd7c-649f7d7cbf9d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:45:11 user nova-compute[75463]: INFO os_vif [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b3:b4,bridge_name='br-int',has_traffic_filtering=True,id=9caf690a-54b9-4d7e-a4fe-5f340846ee29,network=Network(99f914e1-6713-4f9a-86e8-62fe75bae861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9caf690a-54')
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQyszkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:45:11 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8980106e-a9fe-46e1-8a82-00aaf054a371]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:45:11 user nova-compute[75463]: No targets found.
Nov 03 17:45:11 user nova-compute[75463]: iSNS:
Nov 03 17:45:11 user nova-compute[75463]: No targets found.
Nov 03 17:45:11 user nova-compute[75463]: STATIC:
Nov 03 17:45:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d
Nov 03 17:45:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:45:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:45:11 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff
Nov 03 17:45:11 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:45:11 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:45:11 user nova-compute[75463]: FIRMWARE:
Nov 03 17:45:11 user nova-compute[75463]: No targets found.
Nov 03 17:45:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:45:11 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:45:11 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea7e9f-868a-4985-b08c-3ea44e4cf52a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c222302-5cb5-4ada-b490-6df9f9b26c8d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:45:11 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d (non-flash)
Nov 03 17:45:11 user nova-compute[75463]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec587760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa4fe30-47b8-4cd6-85ab-96ae06cc56ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef1b37-1b61-4ec5-b49c-42fe46222965]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[57adf521-050d-4002-911c-94d8c6aeaf6e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ed232-30db-431b-ae0a-a5b3f5b12f05]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating instance_info_cache with network_info: [{"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f080fb-15d2-4e3d-9049-c33823fa9685]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Instance network_info: |[{"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] Acquired lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Refreshing network info cache for port 840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[65190d76-5277-48ba-ba43-79a4b5d8175b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260]
Nov 03 17:45:11 user nova-compute[75463]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d, portal: 172.16.0.220,3260] successful.
Nov 03 17:45:11 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6e0dbb5-d0bd-4266-b3b9-658875f3b74d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[95905704-d46c-4ebe-957b-25e899bb0c43]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] <== disconnect_volume: return (415ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Deleting instance files /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_del
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Deletion of /opt/stack/data/nova/instances/16c9d9b1-e7e6-480c-9f80-682f2f928f19_del complete
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.compute.manager [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 03 17:45:11 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Instance destroyed successfully.
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.objects.instance [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'resources' on Instance uuid 83aae736-2183-4d61-a81b-607ac62688cb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046243823',display_name='tempest-AttachVolumeNegativeTest-server-1046243823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046243823',id=28,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3NZnZzKjTzT3seOaptLMUiwM4+woWCHmB3XHwO7bQpHfixffdgWF+Tmh3SmNb2i+6k+q9zFZzYCELIh08wyXCygur4wlCjtYjpKVLrFYU74zQLhL8kSHLN4rvYIfCEqg==',key_name='tempest-keypair-1991438825',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:42:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-ow67ehff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:42:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=83aae736-2183-4d61-a81b-607ac62688cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "94333704-e017-45ce-9ae2-4e72f7606a68", "address": "fa:16:3e:33:3e:41", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94333704-e0", "ovs_interfaceid": "94333704-e017-45ce-9ae2-4e72f7606a68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG os_vif [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94333704-e0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03c0e992-44a8-4f4c-a11b-1778ecea7d33) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:11 user nova-compute[75463]: INFO os_vif [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3e:41,bridge_name='br-int',has_traffic_filtering=True,id=94333704-e017-45ce-9ae2-4e72f7606a68,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94333704-e0')
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Deleting instance files /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb_del
Nov 03 17:45:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Deletion of /opt/stack/data/nova/instances/83aae736-2183-4d61-a81b-607ac62688cb_del complete
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updated VIF entry in instance network info cache for port 840f836a-7de7-4046-b502-65be4ea2bf0f. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:45:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating instance_info_cache with network_info: [{"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56598593-ca01-4b88-bea4-a216962791ad req-2bc71f04-e0f3-4719-b656-8bcaa6256608 service nova] Releasing lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:45:12 user nova-compute[75463]: INFO nova.compute.manager [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Took 0.85 seconds to deallocate network for instance.
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-345ca3e4-1c7e-4f6d-a262-d19e6be96663 req-3a2ebdca-a75b-4c3a-93b5-b08abb880bcf service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-deleted-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Acquiring lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] No waiting events found dispatching network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:12 user nova-compute[75463]: WARNING nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Received unexpected event network-vif-plugged-9caf690a-54b9-4d7e-a4fe-5f340846ee29 for instance with vm_state active and task_state deleting.
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-unplugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] No waiting events found dispatching network-vif-unplugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-unplugged-94333704-e017-45ce-9ae2-4e72f7606a68 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Acquiring lock "83aae736-2183-4d61-a81b-607ac62688cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] Lock "83aae736-2183-4d61-a81b-607ac62688cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] No waiting events found dispatching network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:12 user nova-compute[75463]: WARNING nova.compute.manager [req-73597f9b-5ac4-4d92-b601-cfb731e593e6 req-96ddee65-a19d-4403-b147-3a835627a60e service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received unexpected event network-vif-plugged-94333704-e017-45ce-9ae2-4e72f7606a68 for instance with vm_state active and task_state deleting.
Nov 03 17:45:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Took 0.81 seconds to deallocate network for instance.
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-4d069824-5ddb-4be5-b9bc-554efc76f523 req-836c3c0b-811e-43df-8b5c-95deb73bb513 service nova] [instance: 83aae736-2183-4d61-a81b-607ac62688cb] Received event network-vif-deleted-94333704-e017-45ce-9ae2-4e72f7606a68 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:13 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:13 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:13 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Deleted allocations for instance 83aae736-2183-4d61-a81b-607ac62688cb
Nov 03 17:45:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-91f694b0-762d-4c95-a373-1f2c617e2f10 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "83aae736-2183-4d61-a81b-607ac62688cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.617s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:13 user nova-compute[75463]: INFO nova.compute.manager [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] [instance: 16c9d9b1-e7e6-480c-9f80-682f2f928f19] Took 1.25 seconds to detach 1 volumes for instance.
Nov 03 17:45:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:14 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:14 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Deleted allocations for instance 16c9d9b1-e7e6-480c-9f80-682f2f928f19
Nov 03 17:45:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-d3dc7b0c-a384-44f7-97bc-61efdc2df0cf tempest-ServerActionsTestOtherB-82187790 tempest-ServerActionsTestOtherB-82187790-project-member] Lock "16c9d9b1-e7e6-480c-9f80-682f2f928f19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.182s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.utils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a1f42f-00b9-41dc-bc7e-50a0bfba8fb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[88604f0c-3ec8-4f3d-974c-4d7fedfa72de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc92e3-fc32-4943-9c6e-edff2ffc5a1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb8b39-79ad-4c30-a9c5-a6a6153b0e32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:45:20 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:45:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7e29e-f41c-442a-afbc-9bf2cdfb59d5]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG os_brick.utils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:45:20 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating existing volume attachment record: 8a050c01-5fde-4c29-9a5f-80a93d3ac0e9 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:45:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:25 user nova-compute[75463]: INFO nova.compute.manager [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Terminating instance
Nov 03 17:45:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-unplugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] No waiting events found dispatching network-vif-unplugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-aa8b76d8-bc9a-4d12-b466-5b42a73a8368 req-bae9a93a-863f-4289-a4d1-6d24a90a5cba service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-unplugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:45:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Instance destroyed successfully.
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'resources' on Instance uuid 1c88997c-7944-4ff0-bb95-5beb891e3b9a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:40:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-880674722',display_name='tempest-VolumesSnapshotTestJSON-instance-880674722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-880674722',id=27,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnBPckBivKxHrqsQom0gsuZEmetx/EQN7ne7+3L3eBOVYZmafhQGTMpZAYheEJDJBjG33kvtRnGpuULhHQuC9zubyLuI2t87YIegUikLaiD2h5fOcXXJPRQ3yNNIMSKwg==',key_name='tempest-keypair-1807799567',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-vson5uwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=1c88997c-7944-4ff0-bb95-5beb891e3b9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "address": "fa:16:3e:c7:cd:e3", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d37cbe-99", "ovs_interfaceid": "b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG os_vif [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9d37cbe-99, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeeabaa6-e691-4db4-ba5a-b35b0ea50046) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:26 user nova-compute[75463]: INFO os_vif [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:cd:e3,bridge_name='br-int',has_traffic_filtering=True,id=b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d37cbe-99')
Nov 03 17:45:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Deleting instance files /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a_del
Nov 03 17:45:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Deletion of /opt/stack/data/nova/instances/1c88997c-7944-4ff0-bb95-5beb891e3b9a_del complete
Nov 03 17:45:26 user nova-compute[75463]: INFO nova.compute.manager [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 03 17:45:26 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:45:26 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:27 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Took 1.05 seconds to deallocate network for instance.
Nov 03 17:45:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-cb8dcfae-159f-45d2-8e77-d0b9bb3332b9 req-a38c1193-4971-4c4f-a693-1718d66f4697 service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-deleted-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:27 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:28 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Deleted allocations for instance 1c88997c-7944-4ff0-bb95-5beb891e3b9a
Nov 03 17:45:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] Acquiring lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] No waiting events found dispatching network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:28 user nova-compute[75463]: WARNING nova.compute.manager [req-822dd7a3-5eda-4f2f-bb83-cabc1a1b3541 req-f26c2f34-e63a-43bb-b9d4-277e33c6a38e service nova] [instance: 1c88997c-7944-4ff0-bb95-5beb891e3b9a] Received unexpected event network-vif-plugged-b9d37cbe-995c-40f4-abfb-cb3c5f6f7ca6 for instance with vm_state deleted and task_state None.
Nov 03 17:45:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7178be05-82eb-45f8-806c-0fec98d4aa43 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "1c88997c-7944-4ff0-bb95-5beb891e3b9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:45:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:45:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:45:43 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Creating image(s)
Nov 03 17:45:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:45:43 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Ensure instance console log exists: /opt/stack/data/nova/instances/62358dcb-ba6b-489f-8348-c7b7d2664eba/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:45:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Start _get_guest_xml network_info=[{"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T17:44:55Z,direct_url=<?>,disk_format='qcow2',id=1d3db8c7-8b61-41bb-8974-87a003e9eec8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1837105062',owner='88d74abcd4a349ab96ba0f188542d61c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T17:44:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvHaVZNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62358dcb-ba6b-489f-8348-c7b7d2664eba', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2bd7eb0-7769-42c3-a353-88ec96cb5337', 'serial': 'b2bd7eb0-7769-42c3-a353-88ec96cb5337'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '8a050c01-5fde-4c29-9a5f-80a93d3ac0e9', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:45:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:45:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-03T17:44:55Z,direct_url=<?>,disk_format='qcow2',id=1d3db8c7-8b61-41bb-8974-87a003e9eec8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1837105062',owner='88d74abcd4a349ab96ba0f188542d61c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-03T17:44:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvHaVZNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:45:44 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:45:44 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:45:44 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2852971e-24b1-489a-962b-78fdcd127228]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:45:44 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fdbe2f-78d5-444f-84aa-7d1d484dcbb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337] added
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e9cbf-6a03-4a23-9e81-5d0dd2e22dca]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[596727b5-8ec3-4416-8431-93949ac1ee1a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvHaVZNL {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvHaVZNL" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5430a8-385f-4425-baa9-ac9255ab3a6b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvHaVZNL'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bead88ce-2375-46ef-b4c4-9e86f4dd4de0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b3e9b-f0fa-43a3-a6f5-1dab47490928]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f8dbb-4800-40c2-8a8b-edf6e2e78f2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260]
Nov 03 17:45:44 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260] successful.
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ffe86-d904-4721-9103-f03adae411c2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4e9dc-daf2-4180-9521-6eb2d0afddd7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:44 user nova-compute[75463]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:45:44 user nova-compute[75463]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)
Nov 03 17:45:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[772a6a66-5301-43d4-a0b4-1b88a47cfd52]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:45:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvHaVZNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23731613634376466', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731613634376466', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1701594974',id=33,image_ref='1d3db8c7-8b61-41bb-8974-87a003e9eec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0hIw385XBGdehrOEjC/Vfz1zEVLEviXfCj82ughaHg47arl/QLsC9DemVNKWIyVqHcb8jdzRo/CwZ9r5Me7EwHDjnc0dOuUHXDFzh7ominP8GR5uYpI5ugXA6nm1MGLQ==',key_name='tempest-keypair-1284618911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-8t98657u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-79691840',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=62358dcb-ba6b-489f-8348-c7b7d2664eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'pci_devices' on Instance uuid 62358dcb-ba6b-489f-8348-c7b7d2664eba {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:45:45 user nova-compute[75463]:   <uuid>62358dcb-ba6b-489f-8348-c7b7d2664eba</uuid>
Nov 03 17:45:45 user nova-compute[75463]:   <name>instance-00000021</name>
Nov 03 17:45:45 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:45:45 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:45:45 user nova-compute[75463]:   <metadata>
Nov 03 17:45:45 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:45:45 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1701594974</nova:name>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:45:44</nova:creationTime>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:45:45 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:45:45 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:owner>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:user uuid="85b5595e7da047d9965cd795b2e6a83b">tempest-TestVolumeBootPattern-79691840-project-member</nova:user>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:project uuid="88d74abcd4a349ab96ba0f188542d61c">tempest-TestVolumeBootPattern-79691840</nova:project>
Nov 03 17:45:45 user nova-compute[75463]:       </nova:owner>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:root type="image" uuid="1d3db8c7-8b61-41bb-8974-87a003e9eec8"/>
Nov 03 17:45:45 user nova-compute[75463]:       <nova:ports>
Nov 03 17:45:45 user nova-compute[75463]:         <nova:port uuid="840f836a-7de7-4046-b502-65be4ea2bf0f">
Nov 03 17:45:45 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:45:45 user nova-compute[75463]:         </nova:port>
Nov 03 17:45:45 user nova-compute[75463]:       </nova:ports>
Nov 03 17:45:45 user nova-compute[75463]:     </nova:instance>
Nov 03 17:45:45 user nova-compute[75463]:   </metadata>
Nov 03 17:45:45 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:45:45 user nova-compute[75463]:     <system>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="serial">62358dcb-ba6b-489f-8348-c7b7d2664eba</entry>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="uuid">62358dcb-ba6b-489f-8348-c7b7d2664eba</entry>
Nov 03 17:45:45 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:45:45 user nova-compute[75463]:     </system>
Nov 03 17:45:45 user nova-compute[75463]:   </sysinfo>
Nov 03 17:45:45 user nova-compute[75463]:   <os>
Nov 03 17:45:45 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:45:45 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:45:45 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:45:45 user nova-compute[75463]:   </os>
Nov 03 17:45:45 user nova-compute[75463]:   <features>
Nov 03 17:45:45 user nova-compute[75463]:     <acpi/>
Nov 03 17:45:45 user nova-compute[75463]:     <apic/>
Nov 03 17:45:45 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:45:45 user nova-compute[75463]:   </features>
Nov 03 17:45:45 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:45:45 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:45:45 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:45:45 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:45:45 user nova-compute[75463]:   </clock>
Nov 03 17:45:45 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:45:45 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:45:45 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:45:45 user nova-compute[75463]:   </cpu>
Nov 03 17:45:45 user nova-compute[75463]:   <devices>
Nov 03 17:45:45 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:45:45 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:45:45 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:45:45 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:45:45 user nova-compute[75463]:       <serial>b2bd7eb0-7769-42c3-a353-88ec96cb5337</serial>
Nov 03 17:45:45 user nova-compute[75463]:     </disk>
Nov 03 17:45:45 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:45:45 user nova-compute[75463]:       <mac address="fa:16:3e:ad:5b:06"/>
Nov 03 17:45:45 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:45:45 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:45:45 user nova-compute[75463]:       <target dev="tap840f836a-7d"/>
Nov 03 17:45:45 user nova-compute[75463]:     </interface>
Nov 03 17:45:45 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:45:45 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/62358dcb-ba6b-489f-8348-c7b7d2664eba/console.log" append="off"/>
Nov 03 17:45:45 user nova-compute[75463]:     </serial>
Nov 03 17:45:45 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:45:45 user nova-compute[75463]:     <video>
Nov 03 17:45:45 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:45:45 user nova-compute[75463]:     </video>
Nov 03 17:45:45 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:45:45 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:45:45 user nova-compute[75463]:     </rng>
Nov 03 17:45:45 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:45:45 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:45:45 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:45:45 user nova-compute[75463]:     </memballoon>
Nov 03 17:45:45 user nova-compute[75463]:   </devices>
Nov 03 17:45:45 user nova-compute[75463]: </domain>
Nov 03 17:45:45 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1701594974',id=33,image_ref='1d3db8c7-8b61-41bb-8974-87a003e9eec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0hIw385XBGdehrOEjC/Vfz1zEVLEviXfCj82ughaHg47arl/QLsC9DemVNKWIyVqHcb8jdzRo/CwZ9r5Me7EwHDjnc0dOuUHXDFzh7ominP8GR5uYpI5ugXA6nm1MGLQ==',key_name='tempest-keypair-1284618911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-8t98657u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-79691840',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=62358dcb-ba6b-489f-8348-c7b7d2664eba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG os_vif [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c92b33d-143e-529e-b65d-1a9499febc3d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap840f836a-7d, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap840f836a-7d, col_values=(('qos', UUID('e923b889-9f16-4492-b460-7895361c74f8')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap840f836a-7d, col_values=(('external_ids', {'iface-id': '840f836a-7de7-4046-b502-65be4ea2bf0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:5b:06', 'vm-uuid': '62358dcb-ba6b-489f-8348-c7b7d2664eba'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:45 user nova-compute[75463]: INFO os_vif [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d')
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:45:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No VIF found with MAC fa:16:3e:ad:5b:06, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:45:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] No waiting events found dispatching network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:47 user nova-compute[75463]: WARNING nova.compute.manager [req-9967c97c-483b-44ce-8619-6bcfadbfceea req-2b1edc81-ec69-482c-8b22-0b8942cddb52 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received unexpected event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f for instance with vm_state building and task_state spawning.
Nov 03 17:45:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:48 user nova-compute[75463]: INFO nova.compute.manager [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Terminating instance
Nov 03 17:45:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-25a176c5-89a2-40f4-b1fb-20e33f844587 req-1ec7f49e-007e-4fbc-8373-bf4a87573edb service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-unplugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] No waiting events found dispatching network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:49 user nova-compute[75463]: WARNING nova.compute.manager [req-807fb75e-b87a-4893-a8cc-3406bc70f50b req-9fd6d236-20cc-47a7-9edb-0e06c1932542 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received unexpected event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f for instance with vm_state building and task_state spawning.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Instance spawned successfully.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Instance destroyed successfully.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.objects.instance [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid bd9327c9-ae8e-424e-ac57-026284f57f85 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1457135785',display_name='tempest-ServerRescueNegativeTestJSON-server-1457135785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1457135785',id=4,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-zuajlzo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:30:52Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=bd9327c9-ae8e-424e-ac57-026284f57f85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "address": "fa:16:3e:9c:12:72", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac39514-25", "ovs_interfaceid": "2ac39514-25cc-4625-95e7-4b440a2a51b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG os_vif [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac39514-25, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.compute.manager [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Took 40.83 seconds to build instance.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=302b01c8-747b-475a-99fc-c7550f072664) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:49 user nova-compute[75463]: INFO os_vif [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:12:72,bridge_name='br-int',has_traffic_filtering=True,id=2ac39514-25cc-4625-95e7-4b440a2a51b2,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac39514-25')
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Deleting instance files /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85_del
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Deletion of /opt/stack/data/nova/instances/bd9327c9-ae8e-424e-ac57-026284f57f85_del complete
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-48ded179-4c0f-4ed9-bdde-eae296bec60f tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.950s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:49 user nova-compute[75463]: INFO nova.compute.manager [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 03 17:45:49 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:45:49 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:45:50 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:45:50 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Took 1.19 seconds to deallocate network for instance.
Nov 03 17:45:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] Acquiring lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] No waiting events found dispatching network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:45:51 user nova-compute[75463]: WARNING nova.compute.manager [req-c6fe88b6-4faa-4511-aa6f-25f1271503ed req-216ab60d-5563-410e-a078-f0c718a7f7df service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received unexpected event network-vif-plugged-2ac39514-25cc-4625-95e7-4b440a2a51b2 for instance with vm_state deleted and task_state None.
Nov 03 17:45:51 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:51 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Deleted allocations for instance bd9327c9-ae8e-424e-ac57-026284f57f85
Nov 03 17:45:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-1890d2f7-96ca-4184-89bc-b706edcf4dcf req-64f293bd-afc1-4a0c-8e8f-f143daf03d50 service nova] [instance: bd9327c9-ae8e-424e-ac57-026284f57f85] Received event network-vif-deleted-2ac39514-25cc-4625-95e7-4b440a2a51b2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:45:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-166a78c0-d63c-433f-866b-8dc4eeaa187b tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "bd9327c9-ae8e-424e-ac57-026284f57f85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.765s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:52 user nova-compute[75463]: WARNING nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid e5be1a8a-4c63-4192-aa6a-d449df611658 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 4830d50c-1d39-4d7d-9503-e35c4cce17ef {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 1845bc31-b26e-4e39-bd20-10cf3c99128f {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 62358dcb-ba6b-489f-8348-c7b7d2664eba {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:52 user nova-compute[75463]: INFO nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 03 17:45:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:45:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:45:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:57 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:45:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:00 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:46:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=7818MB free_disk=25.261302947998047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c79148db-7d6f-4a58-8e75-ead5b154c335 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e5be1a8a-4c63-4192-aa6a-d449df611658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 4830d50c-1d39-4d7d-9503-e35c4cce17ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 62358dcb-ba6b-489f-8348-c7b7d2664eba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:46:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:46:05 user nova-compute[75463]: INFO nova.compute.claims [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Claim successful on node user
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:46:05 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.policy [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aeadce7781c4ef7b888094b5707750a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27744d9d47034ad4bdc36f50bb525282', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:46:05 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Creating image(s)
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "/opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "/opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk 1073741824" returned: 0 in 0.060s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Successfully created port: 056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:06 user nova-compute[75463]: INFO nova.compute.manager [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Terminating instance
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Cannot resize image /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Ensure instance console log exists: /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-unplugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] No waiting events found dispatching network-vif-unplugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-2e44c2fe-5373-4326-be96-fa6c726b9a81 req-dc64a94a-73a8-4c34-bdd6-d0b6f7f7f7d7 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-unplugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Successfully updated port: 056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquired lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:46:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Instance destroyed successfully.
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.objects.instance [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lazy-loading 'resources' on Instance uuid 4830d50c-1d39-4d7d-9503-e35c4cce17ef {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1082869292',display_name='tempest-VolumesNegativeTest-instance-1082869292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1082869292',id=31,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:44:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c9e6f3f65a64c159031d2a285ddc418',ramdisk_id='',reservation_id='r-6xbyphpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2073104485',owner_user_name='tempest-VolumesNegativeTest-2073104485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:44:24Z,user_data=None,user_id='f9adc4e102124fa2ad1a5e2318f7373d',uuid=4830d50c-1d39-4d7d-9503-e35c4cce17ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converting VIF {"id": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "address": "fa:16:3e:1c:09:6e", "network": {"id": "66ab199b-67ba-47b4-ba4a-3ccf4519276e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "01ba08eebc2c4cf88c99391ca06e1bcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b05f26b-eb", "ovs_interfaceid": "2b05f26b-eb2c-4e19-8ca4-c0f267ecc827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG os_vif [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b05f26b-eb, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ba06646-94b8-4634-a07b-25ddecbd8fa6) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: INFO os_vif [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:09:6e,bridge_name='br-int',has_traffic_filtering=True,id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827,network=Network(66ab199b-67ba-47b4-ba4a-3ccf4519276e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b05f26b-eb')
Nov 03 17:46:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Deleting instance files /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef_del
Nov 03 17:46:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Deletion of /opt/stack/data/nova/instances/4830d50c-1d39-4d7d-9503-e35c4cce17ef_del complete
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:46:07 user nova-compute[75463]: INFO nova.compute.manager [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updating instance_info_cache with network_info: [{"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Releasing lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Instance network_info: |[{"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Start _get_guest_xml network_info=[{"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:46:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758816167',display_name='tempest-AttachVolumeNegativeTest-server-1758816167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758816167',id=34,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9dk5lznrXB6QvxhwOyrLkImunSEF9W4/3TOgaA0xg0pUYsAuBr0l/0pbyAcuskYSpszPKuUZakHJBySuNiV3eBeJkyPf6UF+nNK04EeOVMHeWqXSE2LPU7sSdbnwX3ag==',key_name='tempest-keypair-1627992990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-jc3fdw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=5837cfb1-7a42-42c5-96f9-4d73c211789a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'pci_devices' on Instance uuid 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:46:07 user nova-compute[75463]:   <uuid>5837cfb1-7a42-42c5-96f9-4d73c211789a</uuid>
Nov 03 17:46:07 user nova-compute[75463]:   <name>instance-00000022</name>
Nov 03 17:46:07 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:46:07 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:46:07 user nova-compute[75463]:   <metadata>
Nov 03 17:46:07 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:46:07 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1758816167</nova:name>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:46:07</nova:creationTime>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:46:07 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:46:07 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:owner>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:user uuid="7aeadce7781c4ef7b888094b5707750a">tempest-AttachVolumeNegativeTest-731383677-project-member</nova:user>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:project uuid="27744d9d47034ad4bdc36f50bb525282">tempest-AttachVolumeNegativeTest-731383677</nova:project>
Nov 03 17:46:07 user nova-compute[75463]:       </nova:owner>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:46:07 user nova-compute[75463]:       <nova:ports>
Nov 03 17:46:07 user nova-compute[75463]:         <nova:port uuid="056008f2-dac6-4428-9aa8-267ad19668e4">
Nov 03 17:46:07 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 03 17:46:07 user nova-compute[75463]:         </nova:port>
Nov 03 17:46:07 user nova-compute[75463]:       </nova:ports>
Nov 03 17:46:07 user nova-compute[75463]:     </nova:instance>
Nov 03 17:46:07 user nova-compute[75463]:   </metadata>
Nov 03 17:46:07 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:46:07 user nova-compute[75463]:     <system>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="serial">5837cfb1-7a42-42c5-96f9-4d73c211789a</entry>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="uuid">5837cfb1-7a42-42c5-96f9-4d73c211789a</entry>
Nov 03 17:46:07 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:46:07 user nova-compute[75463]:     </system>
Nov 03 17:46:07 user nova-compute[75463]:   </sysinfo>
Nov 03 17:46:07 user nova-compute[75463]:   <os>
Nov 03 17:46:07 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:46:07 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:46:07 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:46:07 user nova-compute[75463]:   </os>
Nov 03 17:46:07 user nova-compute[75463]:   <features>
Nov 03 17:46:07 user nova-compute[75463]:     <acpi/>
Nov 03 17:46:07 user nova-compute[75463]:     <apic/>
Nov 03 17:46:07 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:46:07 user nova-compute[75463]:   </features>
Nov 03 17:46:07 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:46:07 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:46:07 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:46:07 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:46:07 user nova-compute[75463]:   </clock>
Nov 03 17:46:07 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:46:07 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:46:07 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:46:07 user nova-compute[75463]:   </cpu>
Nov 03 17:46:07 user nova-compute[75463]:   <devices>
Nov 03 17:46:07 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:46:07 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:46:07 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk"/>
Nov 03 17:46:07 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:46:07 user nova-compute[75463]:     </disk>
Nov 03 17:46:07 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:46:07 user nova-compute[75463]:       <mac address="fa:16:3e:e7:a0:99"/>
Nov 03 17:46:07 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:46:07 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:46:07 user nova-compute[75463]:       <target dev="tap056008f2-da"/>
Nov 03 17:46:07 user nova-compute[75463]:     </interface>
Nov 03 17:46:07 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:46:07 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/console.log" append="off"/>
Nov 03 17:46:07 user nova-compute[75463]:     </serial>
Nov 03 17:46:07 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:46:07 user nova-compute[75463]:     <video>
Nov 03 17:46:07 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:46:07 user nova-compute[75463]:     </video>
Nov 03 17:46:07 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:46:07 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:46:07 user nova-compute[75463]:     </rng>
Nov 03 17:46:07 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:46:07 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:46:07 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:46:07 user nova-compute[75463]:     </memballoon>
Nov 03 17:46:07 user nova-compute[75463]:   </devices>
Nov 03 17:46:07 user nova-compute[75463]: </domain>
Nov 03 17:46:07 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758816167',display_name='tempest-AttachVolumeNegativeTest-server-1758816167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758816167',id=34,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9dk5lznrXB6QvxhwOyrLkImunSEF9W4/3TOgaA0xg0pUYsAuBr0l/0pbyAcuskYSpszPKuUZakHJBySuNiV3eBeJkyPf6UF+nNK04EeOVMHeWqXSE2LPU7sSdbnwX3ag==',key_name='tempest-keypair-1627992990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-jc3fdw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=5837cfb1-7a42-42c5-96f9-4d73c211789a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG os_vif [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c017430-2a7d-5f8a-9675-6b6559cab987', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap056008f2-da, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap056008f2-da, col_values=(('qos', UUID('7371ca07-2b3a-4e95-b879-5dc0e2082fd6')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap056008f2-da, col_values=(('external_ids', {'iface-id': '056008f2-dac6-4428-9aa8-267ad19668e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:a0:99', 'vm-uuid': '5837cfb1-7a42-42c5-96f9-4d73c211789a'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:07 user nova-compute[75463]: INFO os_vif [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da')
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:e7:a0:99, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:46:07 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:08 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Took 0.47 seconds to deallocate network for instance.
Nov 03 17:46:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8c90db08-c1ae-46a4-b3d2-dc12240e6904 req-25b8d7b1-e94c-4b0e-b9ac-da3b18c02650 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-deleted-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:08 user nova-compute[75463]: INFO nova.compute.manager [req-8c90db08-c1ae-46a4-b3d2-dc12240e6904 req-25b8d7b1-e94c-4b0e-b9ac-da3b18c02650 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Neutron deleted interface 2b05f26b-eb2c-4e19-8ca4-c0f267ecc827; detaching it from the instance and deleting it from the info cache
Nov 03 17:46:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-8c90db08-c1ae-46a4-b3d2-dc12240e6904 req-25b8d7b1-e94c-4b0e-b9ac-da3b18c02650 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8c90db08-c1ae-46a4-b3d2-dc12240e6904 req-25b8d7b1-e94c-4b0e-b9ac-da3b18c02650 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Detach interface failed, port_id=2b05f26b-eb2c-4e19-8ca4-c0f267ecc827, reason: Instance 4830d50c-1d39-4d7d-9503-e35c4cce17ef could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:46:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:08 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Deleted allocations for instance 4830d50c-1d39-4d7d-9503-e35c4cce17ef
Nov 03 17:46:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ad601955-b588-4237-881b-544fd6240019 tempest-VolumesNegativeTest-2073104485 tempest-VolumesNegativeTest-2073104485-project-member] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Acquiring lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Lock "4830d50c-1d39-4d7d-9503-e35c4cce17ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] No waiting events found dispatching network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:09 user nova-compute[75463]: WARNING nova.compute.manager [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 4830d50c-1d39-4d7d-9503-e35c4cce17ef] Received unexpected event network-vif-plugged-2b05f26b-eb2c-4e19-8ca4-c0f267ecc827 for instance with vm_state deleted and task_state None.
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-changed-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Refreshing instance network info cache due to event network-changed-056008f2-dac6-4428-9aa8-267ad19668e4. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Acquiring lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Acquired lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Refreshing network info cache for port 056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updated VIF entry in instance network info cache for port 056008f2-dac6-4428-9aa8-267ad19668e4. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updating instance_info_cache with network_info: [{"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49699562-03ff-4492-b4f8-46a2f7a96cb8 req-fd4ce55f-8066-4b91-8e66-1a5f811c09a1 service nova] Releasing lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] No waiting events found dispatching network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:10 user nova-compute[75463]: WARNING nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received unexpected event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 for instance with vm_state building and task_state spawning.
Nov 03 17:46:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] No waiting events found dispatching network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:10 user nova-compute[75463]: WARNING nova.compute.manager [req-712969be-44f9-4e0d-a805-de0444614702 req-669df4d5-176e-4412-9fb5-7183afe910dc service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received unexpected event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 for instance with vm_state building and task_state spawning.
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:46:11 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Instance spawned successfully.
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:46:11 user nova-compute[75463]: INFO nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 03 17:46:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:46:11 user nova-compute[75463]: INFO nova.compute.manager [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Took 6.48 seconds to build instance.
Nov 03 17:46:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f536fd88-0f6c-409e-9956-24fcbd092439 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.579s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:23 user nova-compute[75463]: INFO nova.compute.manager [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Unshelving
Nov 03 17:46:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_requests' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'numa_topology' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:46:23 user nova-compute[75463]: INFO nova.compute.claims [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Claim successful on node user
Nov 03 17:46:24 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:24 user nova-compute[75463]: INFO nova.network.neutron [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating port ae712e16-12d2-412a-a07f-9ffd0704c6b3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing instance network info cache due to event network-changed-ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:46:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:46:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Creating image(s)
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG nova.network.neutron [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Refreshing network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG nova.objects.base [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<b8270719-4769-4860-950e-ac31e5b72954> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG nova.virt.images [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] 5560bb3c-d8f2-4721-b3d1-94d5f01a0212 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:46:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.part /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG nova.network.neutron [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updated VIF entry in instance network info cache for port ae712e16-12d2-412a-a07f-9ffd0704c6b3. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG nova.network.neutron [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-89e446d0-5bea-47e3-a512-e6611ae09bab req-bca8026c-2eef-4f22-b6cd-8cac1df617fb service nova] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.part /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.converted" returned: 0 in 1.133s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.737s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json" returned: 0 in 0.168s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33,backing_fmt=raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33,backing_fmt=raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk 1073741824" returned: 0 in 0.056s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "5d19641f8e4a7fabaa569d5adf3eaad06f8efc33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'migration_context' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG nova.objects.base [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<b8270719-4769-4860-950e-ac31e5b72954> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:46:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Rebasing disk image.
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f -F raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f -F raw /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk" returned: 0 in 2.786s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Ensure instance console log exists: /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start _get_guest_xml network_info=[{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c19f8f859c840cba6720d3108d7156c',container_format='bare',created_at=2023-11-03T17:44:30Z,direct_url=<?>,disk_format='qcow2',id=5560bb3c-d8f2-4721-b3d1-94d5f01a0212,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1733119461-shelved',owner='a04e2c8b44f54272b2d9e693955fc4ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:46:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c19f8f859c840cba6720d3108d7156c',container_format='bare',created_at=2023-11-03T17:44:30Z,direct_url=<?>,disk_format='qcow2',id=5560bb3c-d8f2-4721-b3d1-94d5f01a0212,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1733119461-shelved',owner='a04e2c8b44f54272b2d9e693955fc4ae',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<b8270719-4769-4860-950e-ac31e5b72954> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='5560bb3c-d8f2-4721-b3d1-94d5f01a0212',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2136500368',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:44:35.577267',shelved_host='user',shelved_image_id='5560bb3c-d8f2-4721-b3d1-94d5f01a0212'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'pci_devices' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.objects.base [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Object Instance<b8270719-4769-4860-950e-ac31e5b72954> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:46:31 user nova-compute[75463]:   <uuid>b8270719-4769-4860-950e-ac31e5b72954</uuid>
Nov 03 17:46:31 user nova-compute[75463]:   <name>instance-0000001d</name>
Nov 03 17:46:31 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:46:31 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:46:31 user nova-compute[75463]:   <metadata>
Nov 03 17:46:31 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:46:31 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1733119461</nova:name>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:46:31</nova:creationTime>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:46:31 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:46:31 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:owner>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:user uuid="939dac096b51462687e049004fe3eb77">tempest-AttachVolumeShelveTestJSON-2020601692-project-member</nova:user>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:project uuid="a04e2c8b44f54272b2d9e693955fc4ae">tempest-AttachVolumeShelveTestJSON-2020601692</nova:project>
Nov 03 17:46:31 user nova-compute[75463]:       </nova:owner>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:root type="image" uuid="5560bb3c-d8f2-4721-b3d1-94d5f01a0212"/>
Nov 03 17:46:31 user nova-compute[75463]:       <nova:ports>
Nov 03 17:46:31 user nova-compute[75463]:         <nova:port uuid="ae712e16-12d2-412a-a07f-9ffd0704c6b3">
Nov 03 17:46:31 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:46:31 user nova-compute[75463]:         </nova:port>
Nov 03 17:46:31 user nova-compute[75463]:       </nova:ports>
Nov 03 17:46:31 user nova-compute[75463]:     </nova:instance>
Nov 03 17:46:31 user nova-compute[75463]:   </metadata>
Nov 03 17:46:31 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:46:31 user nova-compute[75463]:     <system>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="serial">b8270719-4769-4860-950e-ac31e5b72954</entry>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="uuid">b8270719-4769-4860-950e-ac31e5b72954</entry>
Nov 03 17:46:31 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:46:31 user nova-compute[75463]:     </system>
Nov 03 17:46:31 user nova-compute[75463]:   </sysinfo>
Nov 03 17:46:31 user nova-compute[75463]:   <os>
Nov 03 17:46:31 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:46:31 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:46:31 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:46:31 user nova-compute[75463]:   </os>
Nov 03 17:46:31 user nova-compute[75463]:   <features>
Nov 03 17:46:31 user nova-compute[75463]:     <acpi/>
Nov 03 17:46:31 user nova-compute[75463]:     <apic/>
Nov 03 17:46:31 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:46:31 user nova-compute[75463]:   </features>
Nov 03 17:46:31 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:46:31 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:46:31 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:46:31 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:46:31 user nova-compute[75463]:   </clock>
Nov 03 17:46:31 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:46:31 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:46:31 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:46:31 user nova-compute[75463]:   </cpu>
Nov 03 17:46:31 user nova-compute[75463]:   <devices>
Nov 03 17:46:31 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:46:31 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:46:31 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk"/>
Nov 03 17:46:31 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:46:31 user nova-compute[75463]:     </disk>
Nov 03 17:46:31 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:46:31 user nova-compute[75463]:       <mac address="fa:16:3e:0a:72:d4"/>
Nov 03 17:46:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:46:31 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:46:31 user nova-compute[75463]:       <target dev="tapae712e16-12"/>
Nov 03 17:46:31 user nova-compute[75463]:     </interface>
Nov 03 17:46:31 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:46:31 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/console.log" append="off"/>
Nov 03 17:46:31 user nova-compute[75463]:     </serial>
Nov 03 17:46:31 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:46:31 user nova-compute[75463]:     <video>
Nov 03 17:46:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:46:31 user nova-compute[75463]:     </video>
Nov 03 17:46:31 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:46:31 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:46:31 user nova-compute[75463]:     </rng>
Nov 03 17:46:31 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:46:31 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:46:31 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:46:31 user nova-compute[75463]:     </memballoon>
Nov 03 17:46:31 user nova-compute[75463]:   </devices>
Nov 03 17:46:31 user nova-compute[75463]: </domain>
Nov 03 17:46:31 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='5560bb3c-d8f2-4721-b3d1-94d5f01a0212',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2136500368',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member',shelved_at='2023-11-03T17:44:35.577267',shelved_host='user',shelved_image_id='5560bb3c-d8f2-4721-b3d1-94d5f01a0212'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG os_vif [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd52d24b-1503-54b0-a955-d9f6a610a066', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae712e16-12, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae712e16-12, col_values=(('qos', UUID('eb91e508-a6bf-4640-ba2c-903463da6f1e')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae712e16-12, col_values=(('external_ids', {'iface-id': 'ae712e16-12d2-412a-a07f-9ffd0704c6b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:72:d4', 'vm-uuid': 'b8270719-4769-4860-950e-ac31e5b72954'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:31 user nova-compute[75463]: INFO os_vif [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12')
Nov 03 17:46:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:46:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] No VIF found with MAC fa:16:3e:0a:72:d4, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:46:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:33 user nova-compute[75463]: WARNING nova.compute.manager [req-6274a9fa-aeb5-4739-b90a-69f92013fd6b req-4f869b64-2bcd-449c-a58d-c42b559c5d4f service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 17:46:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:35 user nova-compute[75463]: WARNING nova.compute.manager [req-2cd10a77-19dd-464b-8ffa-123144b1a00c req-bf20428d-3116-4fa4-8956-d02d8e291032 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 17:46:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:46:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:46:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance spawned successfully.
Nov 03 17:46:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:46:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a128239f-dcb6-40df-895e-b18946afd6ad tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.812s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:39 user nova-compute[75463]: INFO nova.compute.manager [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Terminating instance
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-760fcd9f-8050-486a-a9ae-d188d133eb6e req-c44f4bae-2657-4170-94e7-ca31e25d5d7f service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-unplugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:46:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Instance destroyed successfully.
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.objects.instance [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lazy-loading 'resources' on Instance uuid c79148db-7d6f-4a58-8e75-ead5b154c335 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1425014350',display_name='tempest-ServerRescueNegativeTestJSON-server-1425014350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1425014350',id=3,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e727b9484bb4bdeb41aff47171cb852',ramdisk_id='',reservation_id='r-dd0gp0wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1657140794',owner_user_name='tempest-ServerRescueNegativeTestJSON-1657140794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:35:42Z,user_data=None,user_id='b1a37cd705cb44c191fe6fad731b4873',uuid=c79148db-7d6f-4a58-8e75-ead5b154c335,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converting VIF {"id": "b2fab86b-cc7b-4661-8776-e89a08742f23", "address": "fa:16:3e:81:a5:56", "network": {"id": "5cd53d6e-1999-45e0-ae2d-86f6e7d99485", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1851447654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e727b9484bb4bdeb41aff47171cb852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2fab86b-cc", "ovs_interfaceid": "b2fab86b-cc7b-4661-8776-e89a08742f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG os_vif [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2fab86b-cc, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c87bf71-476a-49ae-85e7-33b4089bea3e) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:46:39 user nova-compute[75463]: INFO os_vif [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a5:56,bridge_name='br-int',has_traffic_filtering=True,id=b2fab86b-cc7b-4661-8776-e89a08742f23,network=Network(5cd53d6e-1999-45e0-ae2d-86f6e7d99485),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2fab86b-cc')
Nov 03 17:46:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Deleting instance files /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335_del
Nov 03 17:46:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Deletion of /opt/stack/data/nova/instances/c79148db-7d6f-4a58-8e75-ead5b154c335_del complete
Nov 03 17:46:39 user nova-compute[75463]: INFO nova.compute.manager [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 03 17:46:39 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:46:39 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:46:40 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:40 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Took 0.58 seconds to deallocate network for instance.
Nov 03 17:46:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:40 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:46:40 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:46:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:41 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Deleted allocations for instance c79148db-7d6f-4a58-8e75-ead5b154c335
Nov 03 17:46:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ac5385-d71c-4f14-9819-5d12ae05d4c0 tempest-ServerRescueNegativeTestJSON-1657140794 tempest-ServerRescueNegativeTestJSON-1657140794-project-member] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] Acquiring lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] Lock "c79148db-7d6f-4a58-8e75-ead5b154c335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] No waiting events found dispatching network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:46:41 user nova-compute[75463]: WARNING nova.compute.manager [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received unexpected event network-vif-plugged-b2fab86b-cc7b-4661-8776-e89a08742f23 for instance with vm_state deleted and task_state None.
Nov 03 17:46:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-0c475464-153f-4e00-8918-eaf6b57fc6b2 req-43021334-8ff5-49b4-84cc-56c40a6fa80c service nova] [instance: c79148db-7d6f-4a58-8e75-ead5b154c335] Received event network-vif-deleted-b2fab86b-cc7b-4661-8776-e89a08742f23 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-changed-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG nova.compute.manager [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Refreshing instance network info cache due to event network-changed-00d801dc-b4fa-4e5d-b75e-7200e0bd5465. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] Acquiring lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] Acquired lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Refreshing network info cache for port 00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updated VIF entry in instance network info cache for port 00d801dc-b4fa-4e5d-b75e-7200e0bd5465. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG nova.network.neutron [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updating instance_info_cache with network_info: [{"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-63882929-0fe5-4c28-af11-abeb94ca6e38 req-2f6293cf-ad1d-4858-b104-03c736b6486f service nova] Releasing lock "refresh_cache-1845bc31-b26e-4e39-bd20-10cf3c99128f" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:46:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid 1845bc31-b26e-4e39-bd20-10cf3c99128f {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:46:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:46:54 user nova-compute[75463]: INFO nova.compute.manager [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Attaching volume f7c06e90-040d-41ae-83c5-24545594ee21 to /dev/vdb
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.utils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb2aa76-89a0-47c9-ae8e-fbe46335f0d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f4313-cbb6-4138-95d7-d434a565136c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b569ce8-dda7-47ca-95c3-04e789923e4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e9cd6-5de8-44af-8cc7-46c0ea7ba8b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:46:55 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:46:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6089ad8-b8db-4bf8-9193-3b4c332f217e]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG os_brick.utils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:46:55 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updating existing volume attachment record: 8da12493-17fb-4140-87d6-f473df956d8b {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:46:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-changed-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Refreshing instance network info cache due to event network-changed-840f836a-7de7-4046-b502-65be4ea2bf0f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] Acquiring lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] Acquired lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Refreshing network info cache for port 840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updated VIF entry in instance network info cache for port 840f836a-7de7-4046-b502-65be4ea2bf0f. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating instance_info_cache with network_info: [{"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:46:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-224c2a4e-2645-4688-b04b-b0f70954b372 req-969af1e1-657c-4f9a-9916-338f98e5381a service nova] Releasing lock "refresh_cache-62358dcb-ba6b-489f-8348-c7b7d2664eba" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:00 user nova-compute[75463]: INFO nova.compute.manager [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Terminating instance
Nov 03 17:47:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:00 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Instance destroyed successfully.
Nov 03 17:47:00 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'resources' on Instance uuid 62358dcb-ba6b-489f-8348-c7b7d2664eba {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1701594974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1701594974',id=33,image_ref='1d3db8c7-8b61-41bb-8974-87a003e9eec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0hIw385XBGdehrOEjC/Vfz1zEVLEviXfCj82ughaHg47arl/QLsC9DemVNKWIyVqHcb8jdzRo/CwZ9r5Me7EwHDjnc0dOuUHXDFzh7ominP8GR5uYpI5ugXA6nm1MGLQ==',key_name='tempest-keypair-1284618911',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-8t98657u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-79691840',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:45:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=62358dcb-ba6b-489f-8348-c7b7d2664eba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "840f836a-7de7-4046-b502-65be4ea2bf0f", "address": "fa:16:3e:ad:5b:06", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap840f836a-7d", "ovs_interfaceid": "840f836a-7de7-4046-b502-65be4ea2bf0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:47:00 user nova-compute[75463]: DEBUG os_vif [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap840f836a-7d, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e923b889-9f16-4492-b460-7895361c74f8) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:01 user nova-compute[75463]: INFO os_vif [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5b:06,bridge_name='br-int',has_traffic_filtering=True,id=840f836a-7de7-4046-b502-65be4ea2bf0f,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap840f836a-7d')
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvHaVZNL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:47:01 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69fe035-7256-444d-8b9a-355a39e6a0e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:47:01 user nova-compute[75463]: No targets found.
Nov 03 17:47:01 user nova-compute[75463]: iSNS:
Nov 03 17:47:01 user nova-compute[75463]: No targets found.
Nov 03 17:47:01 user nova-compute[75463]: STATIC:
Nov 03 17:47:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337
Nov 03 17:47:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:47:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:47:01 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff
Nov 03 17:47:01 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:47:01 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:47:01 user nova-compute[75463]: FIRMWARE:
Nov 03 17:47:01 user nova-compute[75463]: No targets found.
Nov 03 17:47:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:47:01 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:47:01 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3701c4-a2d6-42d3-96dc-3c23de5a18d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b5933-2942-4ac0-a4e2-73c38d87c516]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:47:01 user nova-compute[75463]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)
Nov 03 17:47:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:47:01 user nova-compute[75463]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 (non-flash)
Nov 03 17:47:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec423d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5a508-6abf-4fe3-8f79-a3575ea24401]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[39844754-eb6f-4d07-8bd7-e1f5a746ea80]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b370e33-9138-4a39-9bb4-cd2895fdbc54]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5e852-5aa8-4647-a6f0-80091d8f9ee4]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c638aeb-d415-479f-bb37-1106c59f56d0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e0543a-4a30-455e-90f9-0232ab8cdbc7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260]
Nov 03 17:47:01 user nova-compute[75463]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337, portal: 172.16.0.220,3260] successful.
Nov 03 17:47:01 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2bd7eb0-7769-42c3-a353-88ec96cb5337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae678486-8219-4157-9621-6fa8455a2d05]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== disconnect_volume: return (325ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:47:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Deleting instance files /opt/stack/data/nova/instances/62358dcb-ba6b-489f-8348-c7b7d2664eba_del
Nov 03 17:47:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Deletion of /opt/stack/data/nova/instances/62358dcb-ba6b-489f-8348-c7b7d2664eba_del complete
Nov 03 17:47:01 user nova-compute[75463]: INFO nova.compute.manager [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-unplugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] No waiting events found dispatching network-vif-unplugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-unplugged-840f836a-7de7-4046-b502-65be4ea2bf0f for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Acquiring lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] No waiting events found dispatching network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:47:01 user nova-compute[75463]: WARNING nova.compute.manager [req-59a5b379-ff86-4af3-a790-c165682bd584 req-8a46f6aa-45c1-46f1-aab3-0027d57771b0 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received unexpected event network-vif-plugged-840f836a-7de7-4046-b502-65be4ea2bf0f for instance with vm_state active and task_state deleting.
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:47:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-3c73b533-a76a-4c71-99eb-b52e91fc5c05 req-9a37f081-19db-40e3-8126-f135b0171da6 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Received event network-vif-deleted-840f836a-7de7-4046-b502-65be4ea2bf0f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:02 user nova-compute[75463]: INFO nova.compute.manager [req-3c73b533-a76a-4c71-99eb-b52e91fc5c05 req-9a37f081-19db-40e3-8126-f135b0171da6 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Neutron deleted interface 840f836a-7de7-4046-b502-65be4ea2bf0f; detaching it from the instance and deleting it from the info cache
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.network.neutron [req-3c73b533-a76a-4c71-99eb-b52e91fc5c05 req-9a37f081-19db-40e3-8126-f135b0171da6 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:02 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Took 0.87 seconds to deallocate network for instance.
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-3c73b533-a76a-4c71-99eb-b52e91fc5c05 req-9a37f081-19db-40e3-8126-f135b0171da6 service nova] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Detach interface failed, port_id=840f836a-7de7-4046-b502-65be4ea2bf0f, reason: Instance 62358dcb-ba6b-489f-8348-c7b7d2664eba could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:03 user nova-compute[75463]: INFO nova.compute.manager [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Took 0.99 seconds to detach 1 volumes for instance.
Nov 03 17:47:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 62358dcb-ba6b-489f-8348-c7b7d2664eba] Deleting volume: b2bd7eb0-7769-42c3-a353-88ec96cb5337 {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.volume.cinder [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Update attachment failed for attachment 8da12493-17fb-4140-87d6-f473df956d8b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Failed to attach f7c06e90-040d-41ae-83c5-24545594ee21 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Traceback (most recent call last):
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     connection_info = volume_api.attachment_update(
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     return method.func(obj, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     return self.request(url, method, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f]     raise exceptions.from_response(resp, body)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441)
Nov 03 17:47:03 user nova-compute[75463]: ERROR nova.compute.manager [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] 
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.799s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server [None req-3830a1c5-647d-4179-990b-a89bdc6f95f1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a4ef2330-d8e3-49a3-b6b4-917e8c41a441)
Nov 03 17:47:03 user nova-compute[75463]: ERROR oslo_messaging.rpc.server 
Nov 03 17:47:03 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:03 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance 62358dcb-ba6b-489f-8348-c7b7d2664eba
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f55ef619-a3d6-44e7-954b-bdccc8e76659 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "62358dcb-ba6b-489f-8348-c7b7d2664eba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.174s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:05 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:47:05 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=25.249053955078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e5be1a8a-4c63-4192-aa6a-d449df611658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 5837cfb1-7a42-42c5-96f9-4d73c211789a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b8270719-4769-4860-950e-ac31e5b72954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:47:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:47:08 user nova-compute[75463]: INFO nova.compute.claims [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Claim successful on node user
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:47:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.policy [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34ccfe3b399641759ece85c3446c89d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5676fbfb840478f89cfb22df7f40af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:47:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Creating image(s)
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "/opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "/opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "/opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk 1073741824" returned: 0 in 0.049s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Successfully created port: fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Cannot resize image /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Ensure instance console log exists: /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Successfully updated port: fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquired lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-changed-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Refreshing instance network info cache due to event network-changed-fc2c1736-044d-4bb3-94c9-9f5db989f31f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] Acquiring lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updating instance_info_cache with network_info: [{"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Releasing lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Instance network_info: |[{"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] Acquired lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Refreshing network info cache for port fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Start _get_guest_xml network_info=[{"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:47:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:47:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-192189819',display_name='tempest-VolumesSnapshotTestJSON-instance-192189819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-192189819',id=35,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/FzdABeGbsi1npfL4/BqUG6aDukfNc+41P/BhycxMpQg2QfNOYQ0qbv8owJqrspuPrciIwducxwjEdUyDe/siNet8Ogvm58Sd6St7gAXHOHhPIJY7JzBEWO0ga+s32Nw==',key_name='tempest-keypair-2141845032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-ktzszxty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=16ba0134-4305-4ecb-b650-c150ebbf24fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'pci_devices' on Instance uuid 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:47:10 user nova-compute[75463]:   <uuid>16ba0134-4305-4ecb-b650-c150ebbf24fa</uuid>
Nov 03 17:47:10 user nova-compute[75463]:   <name>instance-00000023</name>
Nov 03 17:47:10 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:47:10 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:47:10 user nova-compute[75463]:   <metadata>
Nov 03 17:47:10 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:47:10 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-192189819</nova:name>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:47:10</nova:creationTime>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:47:10 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:47:10 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:owner>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:user uuid="34ccfe3b399641759ece85c3446c89d9">tempest-VolumesSnapshotTestJSON-751330893-project-member</nova:user>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:project uuid="b5676fbfb840478f89cfb22df7f40af8">tempest-VolumesSnapshotTestJSON-751330893</nova:project>
Nov 03 17:47:10 user nova-compute[75463]:       </nova:owner>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:47:10 user nova-compute[75463]:       <nova:ports>
Nov 03 17:47:10 user nova-compute[75463]:         <nova:port uuid="fc2c1736-044d-4bb3-94c9-9f5db989f31f">
Nov 03 17:47:10 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 17:47:10 user nova-compute[75463]:         </nova:port>
Nov 03 17:47:10 user nova-compute[75463]:       </nova:ports>
Nov 03 17:47:10 user nova-compute[75463]:     </nova:instance>
Nov 03 17:47:10 user nova-compute[75463]:   </metadata>
Nov 03 17:47:10 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:47:10 user nova-compute[75463]:     <system>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="serial">16ba0134-4305-4ecb-b650-c150ebbf24fa</entry>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="uuid">16ba0134-4305-4ecb-b650-c150ebbf24fa</entry>
Nov 03 17:47:10 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:47:10 user nova-compute[75463]:     </system>
Nov 03 17:47:10 user nova-compute[75463]:   </sysinfo>
Nov 03 17:47:10 user nova-compute[75463]:   <os>
Nov 03 17:47:10 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:47:10 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:47:10 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:47:10 user nova-compute[75463]:   </os>
Nov 03 17:47:10 user nova-compute[75463]:   <features>
Nov 03 17:47:10 user nova-compute[75463]:     <acpi/>
Nov 03 17:47:10 user nova-compute[75463]:     <apic/>
Nov 03 17:47:10 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:47:10 user nova-compute[75463]:   </features>
Nov 03 17:47:10 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:47:10 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:47:10 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:47:10 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:47:10 user nova-compute[75463]:   </clock>
Nov 03 17:47:10 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:47:10 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:47:10 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:47:10 user nova-compute[75463]:   </cpu>
Nov 03 17:47:10 user nova-compute[75463]:   <devices>
Nov 03 17:47:10 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:47:10 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:47:10 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk"/>
Nov 03 17:47:10 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:47:10 user nova-compute[75463]:     </disk>
Nov 03 17:47:10 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:47:10 user nova-compute[75463]:       <mac address="fa:16:3e:46:b9:c6"/>
Nov 03 17:47:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:47:10 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:47:10 user nova-compute[75463]:       <target dev="tapfc2c1736-04"/>
Nov 03 17:47:10 user nova-compute[75463]:     </interface>
Nov 03 17:47:10 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:47:10 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/console.log" append="off"/>
Nov 03 17:47:10 user nova-compute[75463]:     </serial>
Nov 03 17:47:10 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:47:10 user nova-compute[75463]:     <video>
Nov 03 17:47:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:47:10 user nova-compute[75463]:     </video>
Nov 03 17:47:10 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:47:10 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:47:10 user nova-compute[75463]:     </rng>
Nov 03 17:47:10 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:47:10 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:47:10 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:47:10 user nova-compute[75463]:     </memballoon>
Nov 03 17:47:10 user nova-compute[75463]:   </devices>
Nov 03 17:47:10 user nova-compute[75463]: </domain>
Nov 03 17:47:10 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-192189819',display_name='tempest-VolumesSnapshotTestJSON-instance-192189819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-192189819',id=35,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/FzdABeGbsi1npfL4/BqUG6aDukfNc+41P/BhycxMpQg2QfNOYQ0qbv8owJqrspuPrciIwducxwjEdUyDe/siNet8Ogvm58Sd6St7gAXHOHhPIJY7JzBEWO0ga+s32Nw==',key_name='tempest-keypair-2141845032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-ktzszxty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=16ba0134-4305-4ecb-b650-c150ebbf24fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG os_vif [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08e347ba-280f-53f0-957b-264340748e12', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc2c1736-04, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc2c1736-04, col_values=(('qos', UUID('791e36ab-90fc-4249-9b2a-7f78f3e8008a')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc2c1736-04, col_values=(('external_ids', {'iface-id': 'fc2c1736-044d-4bb3-94c9-9f5db989f31f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:b9:c6', 'vm-uuid': '16ba0134-4305-4ecb-b650-c150ebbf24fa'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:10 user nova-compute[75463]: INFO os_vif [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04')
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:47:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No VIF found with MAC fa:16:3e:46:b9:c6, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:47:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updated VIF entry in instance network info cache for port fc2c1736-044d-4bb3-94c9-9f5db989f31f. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:47:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updating instance_info_cache with network_info: [{"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65eeb772-719c-47e9-9de4-e250305b2eb4 req-0e81e8fa-26ba-405e-b8d4-ae57da46b09b service nova] Releasing lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] No waiting events found dispatching network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:47:12 user nova-compute[75463]: WARNING nova.compute.manager [req-81fa4589-e93e-4570-82ea-e38fa39416ca req-6e3363b3-9c6e-466d-a328-264498e24882 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received unexpected event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f for instance with vm_state building and task_state spawning.
Nov 03 17:47:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:47:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Instance spawned successfully.
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] No waiting events found dispatching network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:47:14 user nova-compute[75463]: WARNING nova.compute.manager [req-c0e97562-988e-410c-89c3-79154c1d0b8b req-738b6627-a323-4971-80ba-f4a842d318da service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received unexpected event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f for instance with vm_state building and task_state spawning.
Nov 03 17:47:14 user nova-compute[75463]: INFO nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 03 17:47:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:47:14 user nova-compute[75463]: INFO nova.compute.manager [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Took 6.53 seconds to build instance.
Nov 03 17:47:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a3ebd9cc-0766-493f-8752-61f9ba9a95f1 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:47:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-changed-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Refreshing instance network info cache due to event network-changed-056008f2-dac6-4428-9aa8-267ad19668e4. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] Acquiring lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] Acquired lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Refreshing network info cache for port 056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updated VIF entry in instance network info cache for port 056008f2-dac6-4428-9aa8-267ad19668e4. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updating instance_info_cache with network_info: [{"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:47:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9418d490-6263-4ed5-a763-81edc15fecab req-19b50b4a-c5d9-4b0b-9b8c-f03427b082ca service nova] Releasing lock "refresh_cache-5837cfb1-7a42-42c5-96f9-4d73c211789a" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:47:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:01 user nova-compute[75463]: INFO nova.compute.manager [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Terminating instance
Nov 03 17:48:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-unplugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] No waiting events found dispatching network-vif-unplugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-7ba01fdb-e815-416f-8870-59ed9a886e09 req-b7839aac-128e-4550-99ee-3b2540805e5a service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-unplugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Instance destroyed successfully.
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'resources' on Instance uuid e5be1a8a-4c63-4192-aa6a-d449df611658 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-608297163',display_name='tempest-TestVolumeBootPattern-volume-backed-server-608297163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-608297163',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXLm+9Kzph4TLt/c+Su4sl1Ew4go8CZNzuVTIEtKAQfF1Z74GZTWEeAu6R8Rf8O1Rql52S7hj/KSP0rWYL2vwiZlYW35/2Yslv9JB+x6G9loBiDrz9/Pns1Wj7nmofxRQ==',key_name='tempest-keypair-30668514',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-gq2sgvfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=e5be1a8a-4c63-4192-aa6a-d449df611658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "address": "fa:16:3e:08:b1:fa", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cb5287-97", "ovs_interfaceid": "d1cb5287-97e2-4902-bf33-28f6eec5eb2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_vif [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cb5287-97, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c81335d-4c2b-4da8-966f-65583006a97d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:02 user nova-compute[75463]: INFO os_vif [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:b1:fa,bridge_name='br-int',has_traffic_filtering=True,id=d1cb5287-97e2-4902-bf33-28f6eec5eb2e,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cb5287-97')
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsRtmdJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:48:02 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd27acb-2766-473f-891e-29effb2e2920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:48:02 user nova-compute[75463]: No targets found.
Nov 03 17:48:02 user nova-compute[75463]: iSNS:
Nov 03 17:48:02 user nova-compute[75463]: No targets found.
Nov 03 17:48:02 user nova-compute[75463]: STATIC:
Nov 03 17:48:02 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff
Nov 03 17:48:02 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:48:02 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:48:02 user nova-compute[75463]: FIRMWARE:
Nov 03 17:48:02 user nova-compute[75463]: No targets found.
Nov 03 17:48:02 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:48:02 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:48:02 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb9e6d-6e66-4c6e-a173-576064476a65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[01662b64-3a08-4183-bef7-bab77da3b0a8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:48:02 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff (non-flash)
Nov 03 17:48:02 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec587c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c1df4-a8e7-4c30-9b96-60e8d09db1b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092bbf0-26e1-481b-83d9-162e982fb70d]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b6f831-d5ae-4113-8aba-dda9e44928d2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:02 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1635941-9015-4b45-91e8-06ef83451a4f]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f54e9-e474-4116-bd9d-96963e08a291]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c998d6-a378-449e-b6c3-051506838895]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260]
Nov 03 17:48:03 user nova-compute[75463]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff, portal: 172.16.0.220,3260] successful.
Nov 03 17:48:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae509fc3-4680-415d-82ec-b60dd5bdacff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93a890-6235-4f9b-927a-26389dd920d9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== disconnect_volume: return (329ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:48:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Deleting instance files /opt/stack/data/nova/instances/e5be1a8a-4c63-4192-aa6a-d449df611658_del
Nov 03 17:48:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Deletion of /opt/stack/data/nova/instances/e5be1a8a-4c63-4192-aa6a-d449df611658_del complete
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:03 user nova-compute[75463]: INFO nova.compute.manager [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Attaching volume b43a5901-dedc-48a4-8c78-9dceb43480f4 to /dev/vdb
Nov 03 17:48:03 user nova-compute[75463]: INFO nova.compute.manager [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1002b84-1655-4e12-b0a0-ac37ad1cbdc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26684fc-5063-42d4-b124-29a2f386fdcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdbc141-5e49-40d0-91e4-6fe8e9646409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[95679bb3-9df4-423c-8d01-798709d6c62b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:48:03 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b7786-2f68-4073-a340-7326cf45354c]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updating existing volume attachment record: 14212e02-fa30-4eb3-a940-971c1d83e2ca {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:48:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b8270719-4769-4860-950e-ac31e5b72954] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [{"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-b8270719-4769-4860-950e-ac31e5b72954" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] Acquiring lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] No waiting events found dispatching network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:48:04 user nova-compute[75463]: WARNING nova.compute.manager [req-d11d7330-f63a-4582-b5aa-55ae6f811cc8 req-b67bf6e8-64fd-4333-890b-c73ab9c1a396 service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received unexpected event network-vif-plugged-d1cb5287-97e2-4902-bf33-28f6eec5eb2e for instance with vm_state active and task_state deleting.
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:04 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Took 1.42 seconds to deallocate network for instance.
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.compute.manager [req-3e1efb2f-03e9-457d-aea9-122bad415112 req-c70d1f2b-08f2-49ac-a258-b56e313258aa service nova] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Received event network-vif-deleted-d1cb5287-97e2-4902-bf33-28f6eec5eb2e {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:05 user nova-compute[75463]: INFO nova.compute.manager [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Took 0.96 seconds to detach 1 volumes for instance.
Nov 03 17:48:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: e5be1a8a-4c63-4192-aa6a-d449df611658] Deleting volume: ae509fc3-4680-415d-82ec-b60dd5bdacff {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:06 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance e5be1a8a-4c63-4192-aa6a-d449df611658
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8bbe7ec8-3731-40fc-9235-06209be98768 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "e5be1a8a-4c63-4192-aa6a-d449df611658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.317s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:48:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8131MB free_disk=25.200775146484375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 5837cfb1-7a42-42c5-96f9-4d73c211789a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b8270719-4769-4860-950e-ac31e5b72954 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16ba0134-4305-4ecb-b650-c150ebbf24fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:48:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:13 user nova-compute[75463]: INFO nova.compute.manager [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Terminating instance
Nov 03 17:48:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:48:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-980bc794-af11-42f8-841c-97c7a12e10ba req-376791ab-15e5-4afe-9550-a47582410afe service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-unplugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:48:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Instance destroyed successfully.
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lazy-loading 'resources' on Instance uuid b8270719-4769-4860-950e-ac31e5b72954 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1733119461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1733119461',id=29,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYv+oy6nbIM6kdblCH6XMunW+vfn/d6s7v7HOblKhWo9kBxKj/kwfKpdtI/XX4yyFKdaAp7DNmydTSp8hWhJfNomoCUr7xJi93kZ/PXnwey02EryUn1V07e5jfrVyFahA==',key_name='tempest-keypair-2136500368',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a04e2c8b44f54272b2d9e693955fc4ae',ramdisk_id='',reservation_id='r-ro8cs0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2020601692',owner_user_name='tempest-AttachVolumeShelveTestJSON-2020601692-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939dac096b51462687e049004fe3eb77',uuid=b8270719-4769-4860-950e-ac31e5b72954,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converting VIF {"id": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "address": "fa:16:3e:0a:72:d4", "network": {"id": "abce2bfd-5d8c-406b-8dd1-f03c446bb571", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1377089417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a04e2c8b44f54272b2d9e693955fc4ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae712e16-12", "ovs_interfaceid": "ae712e16-12d2-412a-a07f-9ffd0704c6b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG os_vif [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae712e16-12, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb91e508-a6bf-4640-ba2c-903463da6f1e) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:14 user nova-compute[75463]: INFO os_vif [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=ae712e16-12d2-412a-a07f-9ffd0704c6b3,network=Network(abce2bfd-5d8c-406b-8dd1-f03c446bb571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae712e16-12')
Nov 03 17:48:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Deleting instance files /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954_del
Nov 03 17:48:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Deletion of /opt/stack/data/nova/instances/b8270719-4769-4860-950e-ac31e5b72954_del complete
Nov 03 17:48:14 user nova-compute[75463]: INFO nova.compute.manager [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] [instance: b8270719-4769-4860-950e-ac31e5b72954] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 03 17:48:14 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:48:14 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:48:15 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: b8270719-4769-4860-950e-ac31e5b72954] Took 1.13 seconds to deallocate network for instance.
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-a9165153-343d-49b0-ab4e-19a509f9ce0d req-abb3a81d-687b-4121-811b-150a44ae7ebf service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-deleted-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:15 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Deleted allocations for instance b8270719-4769-4860-950e-ac31e5b72954
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-58691305-085e-4b0a-ac3e-487baae35b91 tempest-AttachVolumeShelveTestJSON-2020601692 tempest-AttachVolumeShelveTestJSON-2020601692-project-member] Lock "b8270719-4769-4860-950e-ac31e5b72954" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.238s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] Acquiring lock "b8270719-4769-4860-950e-ac31e5b72954-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] Lock "b8270719-4769-4860-950e-ac31e5b72954-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] No waiting events found dispatching network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:48:15 user nova-compute[75463]: WARNING nova.compute.manager [req-bddcc9b5-13d1-438b-91ce-505216ec7f7c req-36096ece-cc79-4999-9467-7a87815bc328 service nova] [instance: b8270719-4769-4860-950e-ac31e5b72954] Received unexpected event network-vif-plugged-ae712e16-12d2-412a-a07f-9ffd0704c6b3 for instance with vm_state deleted and task_state None.
Nov 03 17:48:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:48:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcUSmhYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:48:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:48:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:48:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:48:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:48:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:48:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:48:24 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:48:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5fe7f8-ba46-4997-ae82-f306d4d9d4fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:48:25 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a209dea0-30ba-48df-b618-481cb8d4d958]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4] added
Nov 03 17:48:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ae7dd-21a2-49ab-af40-e01d4a132501]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d38926-6ed0-4955-b2ab-2a8e18f328d7]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcUSmhYV {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcUSmhYV" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8826cbbf-760c-4e18-aaa9-d19de0bc2aa5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcUSmhYV'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[19588daf-3d5a-4291-bb42-10687abd17bf]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac8db9-f62c-44db-afa0-84f27a0aa68a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:48:25 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:48:25 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:48:25 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:48:25 user nova-compute[75463]: 
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b3b39-06c4-4ade-b10c-49be5a74cdbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260]
Nov 03 17:48:25 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260] successful.
Nov 03 17:48:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7273a672-d60a-4be0-81f8-aca576c75dc1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da987b8d-8508-44e7-a12e-65c014499d52]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)
Nov 03 17:48:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)
Nov 03 17:48:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864397a-684d-4221-a332-ec35242e07ab]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:48:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcUSmhYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26161353233663666', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161353233663666', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:48:26 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:48:26 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:48:26 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:48:26 user nova-compute[75463]:   <serial>b43a5901-dedc-48a4-8c78-9dceb43480f4</serial>
Nov 03 17:48:26 user nova-compute[75463]: </disk>
Nov 03 17:48:26 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] No VIF found with MAC fa:16:3e:e7:a0:99, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:48:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6115e37e-9480-4a6a-b768-d351527a561a tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.692s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:28 user nova-compute[75463]: INFO nova.compute.manager [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Detaching volume b43a5901-dedc-48a4-8c78-9dceb43480f4
Nov 03 17:48:28 user nova-compute[75463]: INFO nova.virt.block_device [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Attempting to driver detach volume b43a5901-dedc-48a4-8c78-9dceb43480f4 from mountpoint /dev/vdb
Nov 03 17:48:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Attempting to detach device vdb from instance 5837cfb1-7a42-42c5-96f9-4d73c211789a from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:48:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:48:28 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:48:28 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:48:28 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:48:28 user nova-compute[75463]:   <serial>b43a5901-dedc-48a4-8c78-9dceb43480f4</serial>
Nov 03 17:48:28 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:48:28 user nova-compute[75463]: </disk>
Nov 03 17:48:28 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:48:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 5837cfb1-7a42-42c5-96f9-4d73c211789a from the persistent domain config.
Nov 03 17:48:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5837cfb1-7a42-42c5-96f9-4d73c211789a from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:48:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:48:28 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:48:28 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:48:28 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:48:28 user nova-compute[75463]:   <serial>b43a5901-dedc-48a4-8c78-9dceb43480f4</serial>
Nov 03 17:48:28 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:48:28 user nova-compute[75463]: </disk>
Nov 03 17:48:28 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:48:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:48:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:48 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5837cfb1-7a42-42c5-96f9-4d73c211789a is timed out.
Nov 03 17:48:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully detached device vdb from instance 5837cfb1-7a42-42c5-96f9-4d73c211789a from the live domain config.
Nov 03 17:48:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcUSmhYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:48:48 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa2db8-c00b-4255-8ad8-be35a33dca8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:48:48 user nova-compute[75463]: No targets found.
Nov 03 17:48:48 user nova-compute[75463]: iSNS:
Nov 03 17:48:48 user nova-compute[75463]: No targets found.
Nov 03 17:48:48 user nova-compute[75463]: STATIC:
Nov 03 17:48:48 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4
Nov 03 17:48:48 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:48:48 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:48:48 user nova-compute[75463]: FIRMWARE:
Nov 03 17:48:48 user nova-compute[75463]: No targets found.
Nov 03 17:48:48 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:48:48 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:48:48 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[269c0865-2baa-43cb-8f61-d2e551c3ae86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f96284-bf78-400a-8fa1-5227c1c77d8d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)
Nov 03 17:48:48 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 (non-flash)
Nov 03 17:48:48 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0191bf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2113d-d41d-408e-9bba-7f8e552ad0a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c81a3f-e431-4909-a392-ce46a6a4f9e8]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1013b59a-0086-4fa9-bdcf-bb90ab5a9d68]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc706cc-cfee-4212-ae06-47f45ae1a316]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361cfcf-3fc0-4870-8e8d-423cca92a753]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a4c844-c3a0-4e19-b0b7-ed3b67fd7d76]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260]
Nov 03 17:48:48 user nova-compute[75463]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4, portal: 172.16.0.220,3260] successful.
Nov 03 17:48:48 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b43a5901-dedc-48a4-8c78-9dceb43480f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[284e8b56-b903-4bb4-85a1-3324458702c8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] <== disconnect_volume: return (294ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:48:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:48:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:53 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'flavor' on Instance uuid 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4bbcaefe-1198-4ad1-afbb-e18e81caff16 tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.683s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:48:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-changed-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.compute.manager [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Refreshing instance network info cache due to event network-changed-fc2c1736-044d-4bb3-94c9-9f5db989f31f. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] Acquiring lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] Acquired lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Refreshing network info cache for port fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.objects.instance [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'flavor' on Instance uuid 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:48:59 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Ignoring supplied device name: /dev/vdb
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:48:59 user nova-compute[75463]: INFO nova.compute.manager [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Attaching volume b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 to /dev/vdb
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updated VIF entry in instance network info cache for port fc2c1736-044d-4bb3-94c9-9f5db989f31f. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updating instance_info_cache with network_info: [{"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.utils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2192be07-c76a-49a0-b173-bc478f350fff req-0cd1c737-c0f7-4abb-b627-733bc23188af service nova] Releasing lock "refresh_cache-16ba0134-4305-4ecb-b650-c150ebbf24fa" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7535dc13-2233-4513-9519-b6f5bc25093c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0cfeeb-a137-46d9-88ff-39610e5a812e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f1af82-82b7-4efc-8c68-e8da61b9344e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5d294-999a-46af-9884-3fe8f43dc45d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:48:59 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:48:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ffa78d-9673-425c-a3e4-b1024b736c04]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG os_brick.utils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:48:59 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updating existing volume attachment record: 147920d8-1b43-468a-a23f-9f02fa1bb7be {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:49:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:49:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:49:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:04 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:49:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:49:04 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:49:07 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:49:07 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.21713638305664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 5837cfb1-7a42-42c5-96f9-4d73c211789a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16ba0134-4305-4ecb-b650-c150ebbf24fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:49:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:49:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:49:14 user nova-compute[75463]: INFO nova.compute.claims [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Claim successful on node user
Nov 03 17:49:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:49:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:49:14 user nova-compute[75463]: INFO nova.virt.block_device [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Booting with volume 379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 at /dev/vda
Nov 03 17:49:14 user nova-compute[75463]: DEBUG nova.policy [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG os_brick.utils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe969b9-8cf8-4bcf-b662-86f288d5fc93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ba02ed-cc65-4e3e-85ec-d2dfb9c701f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cff7f4-6b02-4ff3-9492-3c493c7570e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb690b56-4a76-453d-881d-0e80560e6088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:49:14 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:49:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8685664-3fa6-4c62-aca0-9234ff8eaac6]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG os_brick.utils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updating existing volume attachment record: e2c28dee-517b-47b0-a2eb-90c062bf6806 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:49:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Successfully created port: 66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Successfully updated port: 66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG nova.compute.manager [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-changed-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG nova.compute.manager [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Refreshing instance network info cache due to event network-changed-66456553-3fad-4dfa-936e-32a65ba84908. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] Acquiring lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:49:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updating instance_info_cache with network_info: [{"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Instance network_info: |[{"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] Acquired lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Refreshing network info cache for port 66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updated VIF entry in instance network info cache for port 66456553-3fad-4dfa-936e-32a65ba84908. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updating instance_info_cache with network_info: [{"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b00a92d0-4281-41aa-b8db-149a0fd60be7 req-7bb42c90-4a69-4511-a1c0-fc6b54638dfc service nova] Releasing lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:49:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:18 user nova-compute[75463]: INFO nova.compute.manager [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Terminating instance
Nov 03 17:49:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-unplugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] No waiting events found dispatching network-vif-unplugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:49:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e566d5e-62f0-4569-b0b0-e53bf31356a5 req-d7b8e895-6864-4855-9633-1a63753b8c4f service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-unplugged-056008f2-dac6-4428-9aa8-267ad19668e4 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Instance destroyed successfully.
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lazy-loading 'resources' on Instance uuid 5837cfb1-7a42-42c5-96f9-4d73c211789a {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1758816167',display_name='tempest-AttachVolumeNegativeTest-server-1758816167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1758816167',id=34,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9dk5lznrXB6QvxhwOyrLkImunSEF9W4/3TOgaA0xg0pUYsAuBr0l/0pbyAcuskYSpszPKuUZakHJBySuNiV3eBeJkyPf6UF+nNK04EeOVMHeWqXSE2LPU7sSdbnwX3ag==',key_name='tempest-keypair-1627992990',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27744d9d47034ad4bdc36f50bb525282',ramdisk_id='',reservation_id='r-jc3fdw2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-731383677',owner_user_name='tempest-AttachVolumeNegativeTest-731383677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aeadce7781c4ef7b888094b5707750a',uuid=5837cfb1-7a42-42c5-96f9-4d73c211789a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converting VIF {"id": "056008f2-dac6-4428-9aa8-267ad19668e4", "address": "fa:16:3e:e7:a0:99", "network": {"id": "06293985-05c8-45ea-a923-8be9b969b2df", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1011375229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27744d9d47034ad4bdc36f50bb525282", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056008f2-da", "ovs_interfaceid": "056008f2-dac6-4428-9aa8-267ad19668e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG os_vif [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap056008f2-da, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7371ca07-2b3a-4e95-b879-5dc0e2082fd6) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:19 user nova-compute[75463]: INFO os_vif [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:a0:99,bridge_name='br-int',has_traffic_filtering=True,id=056008f2-dac6-4428-9aa8-267ad19668e4,network=Network(06293985-05c8-45ea-a923-8be9b969b2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056008f2-da')
Nov 03 17:49:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Deleting instance files /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a_del
Nov 03 17:49:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Deletion of /opt/stack/data/nova/instances/5837cfb1-7a42-42c5-96f9-4d73c211789a_del complete
Nov 03 17:49:19 user nova-compute[75463]: INFO nova.compute.manager [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 03 17:49:19 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:49:19 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:49:20 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Took 1.00 seconds to deallocate network for instance.
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-c173ee7d-6baf-4854-9803-2a4769ad541b req-5abef21c-8066-44c2-9631-1c7dcfb68c27 service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-deleted-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] Acquiring lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.compute.manager [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] No waiting events found dispatching network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:49:20 user nova-compute[75463]: WARNING nova.compute.manager [req-057eff55-4d12-4b20-9ddc-f3c1ec5eab81 req-add04a7b-f954-48a1-979f-cd5ce937151e service nova] [instance: 5837cfb1-7a42-42c5-96f9-4d73c211789a] Received unexpected event network-vif-plugged-056008f2-dac6-4428-9aa8-267ad19668e4 for instance with vm_state deleted and task_state None.
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:49:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:20 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Deleted allocations for instance 5837cfb1-7a42-42c5-96f9-4d73c211789a
Nov 03 17:49:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cf780363-e717-4c2f-b36e-9facce8837ad tempest-AttachVolumeNegativeTest-731383677 tempest-AttachVolumeNegativeTest-731383677-project-member] Lock "5837cfb1-7a42-42c5-96f9-4d73c211789a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykGXuMsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:49:22 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:49:22 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:49:22 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29324ed-d06f-4125-af40-9eb4deeec370]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:49:22 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f57418-769b-435c-bc9f-09a0be413b4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4] added
Nov 03 17:49:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a108f-b0f5-40df-9eeb-8dbd538d6798]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd524de-114f-4a0e-8279-5a45e0bdc671]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykGXuMsJ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykGXuMsJ" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f434b-030f-4b3f-ba9d-b7857bb54153]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykGXuMsJ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd09a1-45bd-4ac2-979b-1535f6a05f0a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb166e4b-d506-41c0-98c0-d1e35bd8247e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:49:22 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:49:22 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:49:22 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:49:22 user nova-compute[75463]: 
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99604cb6-6016-4700-857d-8646923295e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260]
Nov 03 17:49:22 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260] successful.
Nov 03 17:49:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8ddc0-ea64-4b61-83c0-eca68d6f3171]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679cd24-5c20-45e8-9fd3-c718c70f11ea]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdbe8a7-347d-4ac8-8584-4556f64c13da]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:49:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykGXuMsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:49:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:49:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23639643061396331', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:49:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639643061396331', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:49:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'flavor' on Instance uuid 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:49:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:49:23 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:49:23 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:49:23 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:49:23 user nova-compute[75463]:   <serial>b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4</serial>
Nov 03 17:49:23 user nova-compute[75463]: </disk>
Nov 03 17:49:23 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:49:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:49:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:49:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] No VIF found with MAC fa:16:3e:46:b9:c6, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:49:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-499773d1-7484-445b-aafd-dcecf5ef2c29 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.840s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:49:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Creating image(s)
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Ensure instance console log exists: /opt/stack/data/nova/instances/894f53a5-925a-4f69-9478-53ac60dae0ee/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Start _get_guest_xml network_info=[{"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '894f53a5-925a-4f69-9478-53ac60dae0ee', 'attached_at': '', 'detached_at': '', 'volume_id': '379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'serial': '379d4ecb-1513-4250-8d3e-e7cf5bf4ad65'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'e2c28dee-517b-47b0-a2eb-90c062bf6806', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:49:39 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:49:39 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:49:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:49:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:49:39 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2538d1a-0eec-499c-b82d-68d5f08c2b61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:49:39 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f01982-7ad3-451c-a2a8-2782c12fbb12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65] added
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5fbfa1-cdd2-4985-8fc5-d3da92085833]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280828a-e64b-4f86-93ff-a6b7edf77b02]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDVKXIAZ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDVKXIAZ" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80b6b5-e820-4a16-91d2-46762d361ce8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iDVKXIAZ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829190f-c573-45cb-af2f-c9982f9d515d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1ff93-f77e-4c2c-8224-9af2daf39b22]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2cd3ff-1626-4ecd-89fc-7add98d67535]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]
Nov 03 17:49:39 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4439b-4fbc-4562-8748-fd8eb3a6ce67]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ad2a4-0301-40ae-b3de-e860991adf10]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:49:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeda7eb-6209-4c8f-8571-e1ff4f28a8b9]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:49:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23139383338656136', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139383338656136', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1433240479',display_name='tempest-TestVolumeBootPattern-server-1433240479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1433240479',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-xsqmpm7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:49:15Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=894f53a5-925a-4f69-9478-53ac60dae0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.objects.instance [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'pci_devices' on Instance uuid 894f53a5-925a-4f69-9478-53ac60dae0ee {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:49:40 user nova-compute[75463]:   <uuid>894f53a5-925a-4f69-9478-53ac60dae0ee</uuid>
Nov 03 17:49:40 user nova-compute[75463]:   <name>instance-00000024</name>
Nov 03 17:49:40 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:49:40 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:49:40 user nova-compute[75463]:   <metadata>
Nov 03 17:49:40 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:49:40 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:49:40 user nova-compute[75463]:       <nova:name>tempest-TestVolumeBootPattern-server-1433240479</nova:name>
Nov 03 17:49:40 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:49:39</nova:creationTime>
Nov 03 17:49:40 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:49:40 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:49:40 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:49:40 user nova-compute[75463]:       <nova:owner>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:user uuid="85b5595e7da047d9965cd795b2e6a83b">tempest-TestVolumeBootPattern-79691840-project-member</nova:user>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:project uuid="88d74abcd4a349ab96ba0f188542d61c">tempest-TestVolumeBootPattern-79691840</nova:project>
Nov 03 17:49:40 user nova-compute[75463]:       </nova:owner>
Nov 03 17:49:40 user nova-compute[75463]:       <nova:ports>
Nov 03 17:49:40 user nova-compute[75463]:         <nova:port uuid="66456553-3fad-4dfa-936e-32a65ba84908">
Nov 03 17:49:40 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 17:49:40 user nova-compute[75463]:         </nova:port>
Nov 03 17:49:40 user nova-compute[75463]:       </nova:ports>
Nov 03 17:49:40 user nova-compute[75463]:     </nova:instance>
Nov 03 17:49:40 user nova-compute[75463]:   </metadata>
Nov 03 17:49:40 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:49:40 user nova-compute[75463]:     <system>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="serial">894f53a5-925a-4f69-9478-53ac60dae0ee</entry>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="uuid">894f53a5-925a-4f69-9478-53ac60dae0ee</entry>
Nov 03 17:49:40 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:49:40 user nova-compute[75463]:     </system>
Nov 03 17:49:40 user nova-compute[75463]:   </sysinfo>
Nov 03 17:49:40 user nova-compute[75463]:   <os>
Nov 03 17:49:40 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:49:40 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:49:40 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:49:40 user nova-compute[75463]:   </os>
Nov 03 17:49:40 user nova-compute[75463]:   <features>
Nov 03 17:49:40 user nova-compute[75463]:     <acpi/>
Nov 03 17:49:40 user nova-compute[75463]:     <apic/>
Nov 03 17:49:40 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:49:40 user nova-compute[75463]:   </features>
Nov 03 17:49:40 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:49:40 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:49:40 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:49:40 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:49:40 user nova-compute[75463]:   </clock>
Nov 03 17:49:40 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:49:40 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:49:40 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:49:40 user nova-compute[75463]:   </cpu>
Nov 03 17:49:40 user nova-compute[75463]:   <devices>
Nov 03 17:49:40 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:49:40 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:49:40 user nova-compute[75463]:       <source dev="/dev/sdc"/>
Nov 03 17:49:40 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:49:40 user nova-compute[75463]:       <serial>379d4ecb-1513-4250-8d3e-e7cf5bf4ad65</serial>
Nov 03 17:49:40 user nova-compute[75463]:     </disk>
Nov 03 17:49:40 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:49:40 user nova-compute[75463]:       <mac address="fa:16:3e:45:2c:d2"/>
Nov 03 17:49:40 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:49:40 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:49:40 user nova-compute[75463]:       <target dev="tap66456553-3f"/>
Nov 03 17:49:40 user nova-compute[75463]:     </interface>
Nov 03 17:49:40 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:49:40 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/894f53a5-925a-4f69-9478-53ac60dae0ee/console.log" append="off"/>
Nov 03 17:49:40 user nova-compute[75463]:     </serial>
Nov 03 17:49:40 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:49:40 user nova-compute[75463]:     <video>
Nov 03 17:49:40 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:49:40 user nova-compute[75463]:     </video>
Nov 03 17:49:40 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:49:40 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:49:40 user nova-compute[75463]:     </rng>
Nov 03 17:49:40 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:49:40 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:49:40 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:49:40 user nova-compute[75463]:     </memballoon>
Nov 03 17:49:40 user nova-compute[75463]:   </devices>
Nov 03 17:49:40 user nova-compute[75463]: </domain>
Nov 03 17:49:40 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1433240479',display_name='tempest-TestVolumeBootPattern-server-1433240479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1433240479',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-xsqmpm7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:49:15Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=894f53a5-925a-4f69-9478-53ac60dae0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG os_vif [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7964127e-068d-553d-b71a-5c6bc55c8814', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66456553-3f, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66456553-3f, col_values=(('qos', UUID('36ded3d1-d787-4273-9e2e-5d8e2ceb406f')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66456553-3f, col_values=(('external_ids', {'iface-id': '66456553-3fad-4dfa-936e-32a65ba84908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:2c:d2', 'vm-uuid': '894f53a5-925a-4f69-9478-53ac60dae0ee'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:40 user nova-compute[75463]: INFO os_vif [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f')
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:49:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No VIF found with MAC fa:16:3e:45:2c:d2, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] No waiting events found dispatching network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:49:42 user nova-compute[75463]: WARNING nova.compute.manager [req-8923c5e0-8bea-44d9-a7c3-d274f3632afe req-f242072c-5542-4f31-91fb-fc640a913ceb service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received unexpected event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 for instance with vm_state building and task_state spawning.
Nov 03 17:49:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:49:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Instance spawned successfully.
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] No waiting events found dispatching network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:49:44 user nova-compute[75463]: WARNING nova.compute.manager [req-4797c7a2-16eb-4822-b671-644aef2ee3c4 req-1761afab-037e-44bb-b0dc-3675dcfb1d47 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received unexpected event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 for instance with vm_state building and task_state spawning.
Nov 03 17:49:44 user nova-compute[75463]: INFO nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 03 17:49:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:49:44 user nova-compute[75463]: INFO nova.compute.manager [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Took 30.80 seconds to build instance.
Nov 03 17:49:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6679f6cf-1cbb-49ef-ac28-05de6e164989 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.898s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:49:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:50 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:49:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:49:57 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:49:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:50:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:50:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:50:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8309MB free_disk=25.232223510742188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 1845bc31-b26e-4e39-bd20-10cf3c99128f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 16ba0134-4305-4ecb-b650-c150ebbf24fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 894f53a5-925a-4f69-9478-53ac60dae0ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:50:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:50:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:50:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:50:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:11 user nova-compute[75463]: INFO nova.compute.manager [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Terminating instance
Nov 03 17:50:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-unplugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] No waiting events found dispatching network-vif-unplugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-d239745d-bd09-46a2-8c55-e53305c681e7 req-585776f6-766d-43db-9428-718b5555ee2f service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-unplugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:50:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Instance destroyed successfully.
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.objects.instance [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'resources' on Instance uuid 1845bc31-b26e-4e39-bd20-10cf3c99128f {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-614403362',display_name='tempest-AttachVolumeTestJSON-server-614403362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-614403362',id=32,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbo96TnEhyjB+RlBmqU7h0WZehuR1/ciRN259W0+UeZeND3EaRr9WgsE2zG8GPZS5BKCZMXeqf8V90Kn6OzeqfR/g4fP6A3n3CLIEnbwVp2c7Cxi1111ndF+83N0Q0jwg==',key_name='tempest-keypair-1447222031',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-6721qp0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=1845bc31-b26e-4e39-bd20-10cf3c99128f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "address": "fa:16:3e:93:6d:4b", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d801dc-b4", "ovs_interfaceid": "00d801dc-b4fa-4e5d-b75e-7200e0bd5465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG os_vif [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00d801dc-b4, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cab3422-c564-4cb2-ae5a-41fb4a613c7d) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:12 user nova-compute[75463]: INFO os_vif [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=00d801dc-b4fa-4e5d-b75e-7200e0bd5465,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d801dc-b4')
Nov 03 17:50:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Deleting instance files /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f_del
Nov 03 17:50:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Deletion of /opt/stack/data/nova/instances/1845bc31-b26e-4e39-bd20-10cf3c99128f_del complete
Nov 03 17:50:12 user nova-compute[75463]: INFO nova.compute.manager [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 03 17:50:12 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:50:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Took 0.80 seconds to deallocate network for instance.
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:13 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Deleted allocations for instance 1845bc31-b26e-4e39-bd20-10cf3c99128f
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-904fdc60-7eac-4ca6-ae41-f929f94816ea tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] Acquiring lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] Lock "1845bc31-b26e-4e39-bd20-10cf3c99128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] No waiting events found dispatching network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:13 user nova-compute[75463]: WARNING nova.compute.manager [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received unexpected event network-vif-plugged-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 for instance with vm_state deleted and task_state None.
Nov 03 17:50:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-49ef2e57-f170-4bee-91ed-7d2974cb6c06 req-c5752a82-9227-4f0e-a825-8237c5ca1294 service nova] [instance: 1845bc31-b26e-4e39-bd20-10cf3c99128f] Received event network-vif-deleted-00d801dc-b4fa-4e5d-b75e-7200e0bd5465 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.compute.manager [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Detaching volume b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.compute.claims [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Claim successful on node user
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.virt.block_device [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Attempting to driver detach volume b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 from mountpoint /dev/vdb
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Attempting to detach device vdb from instance 16ba0134-4305-4ecb-b650-c150ebbf24fa from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:50:29 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:50:29 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:50:29 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:50:29 user nova-compute[75463]:   <serial>b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4</serial>
Nov 03 17:50:29 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:50:29 user nova-compute[75463]: </disk>
Nov 03 17:50:29 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully detached device vdb from instance 16ba0134-4305-4ecb-b650-c150ebbf24fa from the persistent domain config.
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16ba0134-4305-4ecb-b650-c150ebbf24fa from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:50:29 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:50:29 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:50:29 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:50:29 user nova-compute[75463]:   <serial>b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4</serial>
Nov 03 17:50:29 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:50:29 user nova-compute[75463]: </disk>
Nov 03 17:50:29 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.policy [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8898fdead75544f38f127638944e9610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62e0bcc91646989f6433e3692f0dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:50:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Creating image(s)
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "/opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "/opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.215s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk 1073741824" returned: 0 in 0.061s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Successfully created port: 62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Cannot resize image /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Ensure instance console log exists: /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Successfully updated port: 62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquired lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-changed-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.compute.manager [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Refreshing instance network info cache due to event network-changed-62e335e0-6935-45e5-8762-5515ce671471. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] Acquiring lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Updating instance_info_cache with network_info: [{"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Releasing lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Instance network_info: |[{"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] Acquired lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.neutron [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Refreshing network info cache for port 62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Start _get_guest_xml network_info=[{"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:50:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:50:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1586417069',display_name='tempest-VolumesActionsTest-instance-1586417069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1586417069',id=37,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-0ap2a1bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:50:30Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=d3bdc131-37c6-45dc-af53-d2aa5d2f7103,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lazy-loading 'pci_devices' on Instance uuid d3bdc131-37c6-45dc-af53-d2aa5d2f7103 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:50:31 user nova-compute[75463]:   <uuid>d3bdc131-37c6-45dc-af53-d2aa5d2f7103</uuid>
Nov 03 17:50:31 user nova-compute[75463]:   <name>instance-00000025</name>
Nov 03 17:50:31 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:50:31 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:50:31 user nova-compute[75463]:   <metadata>
Nov 03 17:50:31 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:50:31 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:name>tempest-VolumesActionsTest-instance-1586417069</nova:name>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:50:31</nova:creationTime>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:50:31 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:50:31 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:owner>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:user uuid="8898fdead75544f38f127638944e9610">tempest-VolumesActionsTest-136348732-project-member</nova:user>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:project uuid="fe62e0bcc91646989f6433e3692f0dfe">tempest-VolumesActionsTest-136348732</nova:project>
Nov 03 17:50:31 user nova-compute[75463]:       </nova:owner>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:50:31 user nova-compute[75463]:       <nova:ports>
Nov 03 17:50:31 user nova-compute[75463]:         <nova:port uuid="62e335e0-6935-45e5-8762-5515ce671471">
Nov 03 17:50:31 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 03 17:50:31 user nova-compute[75463]:         </nova:port>
Nov 03 17:50:31 user nova-compute[75463]:       </nova:ports>
Nov 03 17:50:31 user nova-compute[75463]:     </nova:instance>
Nov 03 17:50:31 user nova-compute[75463]:   </metadata>
Nov 03 17:50:31 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:50:31 user nova-compute[75463]:     <system>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="serial">d3bdc131-37c6-45dc-af53-d2aa5d2f7103</entry>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="uuid">d3bdc131-37c6-45dc-af53-d2aa5d2f7103</entry>
Nov 03 17:50:31 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:50:31 user nova-compute[75463]:     </system>
Nov 03 17:50:31 user nova-compute[75463]:   </sysinfo>
Nov 03 17:50:31 user nova-compute[75463]:   <os>
Nov 03 17:50:31 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:50:31 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:50:31 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:50:31 user nova-compute[75463]:   </os>
Nov 03 17:50:31 user nova-compute[75463]:   <features>
Nov 03 17:50:31 user nova-compute[75463]:     <acpi/>
Nov 03 17:50:31 user nova-compute[75463]:     <apic/>
Nov 03 17:50:31 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:50:31 user nova-compute[75463]:   </features>
Nov 03 17:50:31 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:50:31 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:50:31 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:50:31 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:50:31 user nova-compute[75463]:   </clock>
Nov 03 17:50:31 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:50:31 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:50:31 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:50:31 user nova-compute[75463]:   </cpu>
Nov 03 17:50:31 user nova-compute[75463]:   <devices>
Nov 03 17:50:31 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:50:31 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:50:31 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk"/>
Nov 03 17:50:31 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:50:31 user nova-compute[75463]:     </disk>
Nov 03 17:50:31 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:50:31 user nova-compute[75463]:       <mac address="fa:16:3e:b2:9e:07"/>
Nov 03 17:50:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:50:31 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:50:31 user nova-compute[75463]:       <target dev="tap62e335e0-69"/>
Nov 03 17:50:31 user nova-compute[75463]:     </interface>
Nov 03 17:50:31 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:50:31 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/console.log" append="off"/>
Nov 03 17:50:31 user nova-compute[75463]:     </serial>
Nov 03 17:50:31 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:50:31 user nova-compute[75463]:     <video>
Nov 03 17:50:31 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:50:31 user nova-compute[75463]:     </video>
Nov 03 17:50:31 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:50:31 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:50:31 user nova-compute[75463]:     </rng>
Nov 03 17:50:31 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:50:31 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:50:31 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:50:31 user nova-compute[75463]:     </memballoon>
Nov 03 17:50:31 user nova-compute[75463]:   </devices>
Nov 03 17:50:31 user nova-compute[75463]: </domain>
Nov 03 17:50:31 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1586417069',display_name='tempest-VolumesActionsTest-instance-1586417069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1586417069',id=37,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-0ap2a1bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:50:30Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=d3bdc131-37c6-45dc-af53-d2aa5d2f7103,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG os_vif [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4214c3e2-0a80-5807-ac25-ac0a820e5e08', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62e335e0-69, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62e335e0-69, col_values=(('qos', UUID('6fb70dc3-f060-4d8c-9c6f-27b9b42a8464')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62e335e0-69, col_values=(('external_ids', {'iface-id': '62e335e0-6935-45e5-8762-5515ce671471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:9e:07', 'vm-uuid': 'd3bdc131-37c6-45dc-af53-d2aa5d2f7103'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:31 user nova-compute[75463]: INFO os_vif [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69')
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:50:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] No VIF found with MAC fa:16:3e:b2:9e:07, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:50:32 user nova-compute[75463]: DEBUG nova.network.neutron [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Updated VIF entry in instance network info cache for port 62e335e0-6935-45e5-8762-5515ce671471. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:50:32 user nova-compute[75463]: DEBUG nova.network.neutron [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Updating instance_info_cache with network_info: [{"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:50:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-874a7082-d5fd-4885-b798-e23f81add8bb req-69ea6a34-5f24-4777-84f7-6d99bab9d4b2 service nova] Releasing lock "refresh_cache-d3bdc131-37c6-45dc-af53-d2aa5d2f7103" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] No waiting events found dispatching network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:33 user nova-compute[75463]: WARNING nova.compute.manager [req-d5522de0-2dd0-4128-a07d-d059950753b1 req-5674f8cd-c639-42d4-98c4-6bd62c664459 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received unexpected event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 for instance with vm_state building and task_state spawning.
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:50:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Instance spawned successfully.
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:50:35 user nova-compute[75463]: INFO nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:50:35 user nova-compute[75463]: INFO nova.compute.manager [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Took 6.49 seconds to build instance.
Nov 03 17:50:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa7cb79a-8b9f-47ca-bc99-48d8942de0ad tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.598s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] No waiting events found dispatching network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:35 user nova-compute[75463]: WARNING nova.compute.manager [req-77ba721e-86d4-48df-8a79-152d91020ea8 req-2e0e0506-f94d-4c3b-af21-257a90cc7a94 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received unexpected event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 for instance with vm_state active and task_state None.
Nov 03 17:50:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16ba0134-4305-4ecb-b650-c150ebbf24fa is timed out.
Nov 03 17:50:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully detached device vdb from instance 16ba0134-4305-4ecb-b650-c150ebbf24fa from the live domain config.
Nov 03 17:50:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykGXuMsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:50:49 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872135b-1ea8-4cff-841d-844a964554b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:50:49 user nova-compute[75463]: No targets found.
Nov 03 17:50:49 user nova-compute[75463]: iSNS:
Nov 03 17:50:49 user nova-compute[75463]: No targets found.
Nov 03 17:50:49 user nova-compute[75463]: STATIC:
Nov 03 17:50:49 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:50:49 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:50:49 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:50:49 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4
Nov 03 17:50:49 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:50:49 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:50:49 user nova-compute[75463]: FIRMWARE:
Nov 03 17:50:49 user nova-compute[75463]: No targets found.
Nov 03 17:50:49 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:50:49 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:50:49 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c034dea0-8aff-4aa8-8ddf-c40b269b06a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9a05cc-1e59-454f-aa86-f0860b7b3c58]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:50:49 user nova-compute[75463]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:50:49 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 (non-flash)
Nov 03 17:50:49 user nova-compute[75463]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:50:49 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c58cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a54a33-a058-47ec-8bab-988a75cfc52a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a3ced2-1371-4402-a9b4-5e7f1a008d92]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a8596-6afe-433e-bd40-857c47f30700]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f918ed-b42e-4d30-b2b2-64e95ced46f3]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:50:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd860e6e-ee03-4c11-a232-c99680b4bc42]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9e3967-d78c-4d80-9db6-a9228f7832e6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260]
Nov 03 17:50:50 user nova-compute[75463]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4, portal: 172.16.0.220,3260] successful.
Nov 03 17:50:50 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7d39de-7f84-43c7-abb2-56ebb938d413]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] <== disconnect_volume: return (299ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:50:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'flavor' on Instance uuid 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1fc5b6c5-69af-459f-be2c-e7c2c6ac3f4a tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.837s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:51 user nova-compute[75463]: INFO nova.compute.manager [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Terminating instance
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-unplugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] No waiting events found dispatching network-vif-unplugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.compute.manager [req-657f625b-444b-41a3-bd44-70dbb17cda91 req-21e32cf4-3cee-49dc-a6de-8644ba1d01d7 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-unplugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Instance destroyed successfully.
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.objects.instance [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lazy-loading 'resources' on Instance uuid 16ba0134-4305-4ecb-b650-c150ebbf24fa {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-192189819',display_name='tempest-VolumesSnapshotTestJSON-instance-192189819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-192189819',id=35,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/FzdABeGbsi1npfL4/BqUG6aDukfNc+41P/BhycxMpQg2QfNOYQ0qbv8owJqrspuPrciIwducxwjEdUyDe/siNet8Ogvm58Sd6St7gAXHOHhPIJY7JzBEWO0ga+s32Nw==',key_name='tempest-keypair-2141845032',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:47:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5676fbfb840478f89cfb22df7f40af8',ramdisk_id='',reservation_id='r-ktzszxty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-751330893',owner_user_name='tempest-VolumesSnapshotTestJSON-751330893-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccfe3b399641759ece85c3446c89d9',uuid=16ba0134-4305-4ecb-b650-c150ebbf24fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converting VIF {"id": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "address": "fa:16:3e:46:b9:c6", "network": {"id": "e953c8bb-33b5-4c0b-bc5e-363246f96227", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1953934496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5676fbfb840478f89cfb22df7f40af8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc2c1736-04", "ovs_interfaceid": "fc2c1736-044d-4bb3-94c9-9f5db989f31f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_vif [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc2c1736-04, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=791e36ab-90fc-4249-9b2a-7f78f3e8008a) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:51 user nova-compute[75463]: INFO os_vif [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc2c1736-044d-4bb3-94c9-9f5db989f31f,network=Network(e953c8bb-33b5-4c0b-bc5e-363246f96227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc2c1736-04')
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykGXuMsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:50:51 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[91778291-9bf8-4e7f-b55b-ab335ec1ae1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:50:51 user nova-compute[75463]: No targets found.
Nov 03 17:50:51 user nova-compute[75463]: iSNS:
Nov 03 17:50:51 user nova-compute[75463]: No targets found.
Nov 03 17:50:51 user nova-compute[75463]: STATIC:
Nov 03 17:50:51 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:50:51 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:50:51 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:50:51 user nova-compute[75463]: FIRMWARE:
Nov 03 17:50:51 user nova-compute[75463]: No targets found.
Nov 03 17:50:51 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:50:51 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:50:51 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ae61d6-1ec3-4a53-97c2-a7caac4e3ae4', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5932cb-e957-40ad-a4c1-b4589c876af7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dcb0a1-45ac-4fb9-a4f6-392578f7cd12]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:50:51 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:50:51 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec5ef250>, {}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Disconnecting from: [] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] <== disconnect_volume: return (68ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:50:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:50:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Deleting instance files /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa_del
Nov 03 17:50:51 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Deletion of /opt/stack/data/nova/instances/16ba0134-4305-4ecb-b650-c150ebbf24fa_del complete
Nov 03 17:50:52 user nova-compute[75463]: INFO nova.compute.manager [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 17:50:52 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:50:52 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:50:52 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:50:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:52 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:50:52 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Took 0.90 seconds to deallocate network for instance.
Nov 03 17:50:52 user nova-compute[75463]: WARNING nova.volume.cinder [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Attachment 147920d8-1b43-468a-a23f-9f02fa1bb7be does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 147920d8-1b43-468a-a23f-9f02fa1bb7be. (HTTP 404) (Request-ID: req-ff7b93db-3cf4-4248-9a87-562fcdd0f71c)
Nov 03 17:50:52 user nova-compute[75463]: INFO nova.compute.manager [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Took 0.02 seconds to detach 1 volumes for instance.
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:53 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Deleted allocations for instance 16ba0134-4305-4ecb-b650-c150ebbf24fa
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-23ec7a72-097f-47e9-ba66-723ca679e2f7 tempest-VolumesSnapshotTestJSON-751330893 tempest-VolumesSnapshotTestJSON-751330893-project-member] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] Acquiring lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] Lock "16ba0134-4305-4ecb-b650-c150ebbf24fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:50:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] No waiting events found dispatching network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:50:53 user nova-compute[75463]: WARNING nova.compute.manager [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received unexpected event network-vif-plugged-fc2c1736-044d-4bb3-94c9-9f5db989f31f for instance with vm_state deleted and task_state None.
Nov 03 17:50:53 user nova-compute[75463]: DEBUG nova.compute.manager [req-cddd6a9e-1b80-497e-a82b-e4c55bacdc3d req-8d4eb312-117d-45f8-943d-08906a7e0978 service nova] [instance: 16ba0134-4305-4ecb-b650-c150ebbf24fa] Received event network-vif-deleted-fc2c1736-044d-4bb3-94c9-9f5db989f31f {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:50:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:50:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:50:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:51:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 17:51:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:51:07 user nova-compute[75463]: INFO nova.compute.claims [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Claim successful on node user
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-changed-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Refreshing instance network info cache due to event network-changed-66456553-3fad-4dfa-936e-32a65ba84908. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] Acquiring lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] Acquired lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.network.neutron [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Refreshing network info cache for port 66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:51:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.policy [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45610cefcbb242f5a049f3fb3eaaa110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4f349c4a854f55a6f5c8a3b6003893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:07 user nova-compute[75463]: INFO nova.compute.manager [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Terminating instance
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:51:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Creating image(s)
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "/opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "/opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.219s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:07 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-unplugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] No waiting events found dispatching network-vif-unplugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8893e651-c9da-4c9c-b111-9b7555517b12 req-9bb5f305-9807-40b3-ba52-e240b60ee272 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-unplugged-66456553-3fad-4dfa-936e-32a65ba84908 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.224s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk 1073741824" returned: 0 in 0.053s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Instance destroyed successfully.
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'resources' on Instance uuid 894f53a5-925a-4f69-9478-53ac60dae0ee {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Successfully created port: d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.235s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:49:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1433240479',display_name='tempest-TestVolumeBootPattern-server-1433240479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1433240479',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-xsqmpm7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:49:45Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=894f53a5-925a-4f69-9478-53ac60dae0ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_vif [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66456553-3f, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36ded3d1-d787-4273-9e2e-5d8e2ceb406f) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:51:08 user nova-compute[75463]: INFO os_vif [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2c:d2,bridge_name='br-int',has_traffic_filtering=True,id=66456553-3fad-4dfa-936e-32a65ba84908,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66456553-3f')
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:51:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190c62d-d735-49d3-b18b-4affe840b461]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:51:08 user nova-compute[75463]: No targets found.
Nov 03 17:51:08 user nova-compute[75463]: iSNS:
Nov 03 17:51:08 user nova-compute[75463]: No targets found.
Nov 03 17:51:08 user nova-compute[75463]: STATIC:
Nov 03 17:51:08 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:51:08 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:51:08 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:51:08 user nova-compute[75463]: FIRMWARE:
Nov 03 17:51:08 user nova-compute[75463]: No targets found.
Nov 03 17:51:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:51:08 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:51:08 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updated VIF entry in instance network info cache for port 66456553-3fad-4dfa-936e-32a65ba84908. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updating instance_info_cache with network_info: [{"id": "66456553-3fad-4dfa-936e-32a65ba84908", "address": "fa:16:3e:45:2c:d2", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66456553-3f", "ovs_interfaceid": "66456553-3fad-4dfa-936e-32a65ba84908", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9361db-1840-4227-bb94-28a9f7f691ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7d46fa5a-8bb0-48bf-93d0-042b789a8873 req-fd3c49a9-a631-41db-85fd-1d90b5d95d1c service nova] Releasing lock "refresh_cache-894f53a5-925a-4f69-9478-53ac60dae0ee" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e065a1a-98bf-4bf1-88ac-e81f2ed0ede0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:51:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:51:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe0141224d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Cannot resize image /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Ensure instance console log exists: /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2d674-c938-44cc-928d-4364dc0f7e29]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[063ed5c1-4e24-454d-98bc-b7f25a15f6f5]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c396ae8a-7fa7-45d6-ac0b-d5f2a1c70978]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[16167c53-d821-40e0-b46b-b20dc8cd77b9]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaffb2950-19838ea604b9c622', '/dev/disk/by-id/scsi-23139383338656136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_affb2950') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008af48-90f4-4ece-a980-bf4e9a54790f]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc058fae-db01-49a6-814e-db086ff64fb4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd31394c-f34e-4fe3-a8d2-fc1d1a1975c4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]
Nov 03 17:51:09 user nova-compute[75463]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.
Nov 03 17:51:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27368d-daa5-4323-9e84-5146ee394450]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== disconnect_volume: return (397ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:51:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Deleting instance files /opt/stack/data/nova/instances/894f53a5-925a-4f69-9478-53ac60dae0ee_del
Nov 03 17:51:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Deletion of /opt/stack/data/nova/instances/894f53a5-925a-4f69-9478-53ac60dae0ee_del complete
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:09 user nova-compute[75463]: INFO nova.compute.manager [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Successfully updated port: d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquired lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-changed-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Refreshing instance network info cache due to event network-changed-d820a593-b5d7-48f0-80b1-b4fcb7748d43. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] Acquiring lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating instance_info_cache with network_info: [{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Releasing lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Instance network_info: |[{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] Acquired lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Refreshing network info cache for port d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:51:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Start _get_guest_xml network_info=[{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:51:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:51:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=25.24544906616211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:51:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1317632656',display_name='tempest-AttachVolumeTestJSON-server-1317632656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1317632656',id=38,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9e6ov0G/vlYVlRMbXpaVjlcyqHPkBIxYAVFjPahymEIsYFOmrPW5G17B+/hs3p694rDSlohILB/tnG4voKIsJ7H7pVtE6xVjPLhKdaK8E2mdQOUjwWWixu1PsSorRCkw==',key_name='tempest-keypair-992452773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-qgb5qsjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=e1b2f438-8a36-464d-b94e-c5f46f8e3704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'pci_devices' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:51:10 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Took 0.98 seconds to deallocate network for instance.
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:51:10 user nova-compute[75463]:   <uuid>e1b2f438-8a36-464d-b94e-c5f46f8e3704</uuid>
Nov 03 17:51:10 user nova-compute[75463]:   <name>instance-00000026</name>
Nov 03 17:51:10 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:51:10 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:51:10 user nova-compute[75463]:   <metadata>
Nov 03 17:51:10 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:51:10 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:name>tempest-AttachVolumeTestJSON-server-1317632656</nova:name>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:51:10</nova:creationTime>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:51:10 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:51:10 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:owner>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:user uuid="45610cefcbb242f5a049f3fb3eaaa110">tempest-AttachVolumeTestJSON-1212926870-project-member</nova:user>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:project uuid="9d4f349c4a854f55a6f5c8a3b6003893">tempest-AttachVolumeTestJSON-1212926870</nova:project>
Nov 03 17:51:10 user nova-compute[75463]:       </nova:owner>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:51:10 user nova-compute[75463]:       <nova:ports>
Nov 03 17:51:10 user nova-compute[75463]:         <nova:port uuid="d820a593-b5d7-48f0-80b1-b4fcb7748d43">
Nov 03 17:51:10 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 03 17:51:10 user nova-compute[75463]:         </nova:port>
Nov 03 17:51:10 user nova-compute[75463]:       </nova:ports>
Nov 03 17:51:10 user nova-compute[75463]:     </nova:instance>
Nov 03 17:51:10 user nova-compute[75463]:   </metadata>
Nov 03 17:51:10 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:51:10 user nova-compute[75463]:     <system>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="serial">e1b2f438-8a36-464d-b94e-c5f46f8e3704</entry>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="uuid">e1b2f438-8a36-464d-b94e-c5f46f8e3704</entry>
Nov 03 17:51:10 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:51:10 user nova-compute[75463]:     </system>
Nov 03 17:51:10 user nova-compute[75463]:   </sysinfo>
Nov 03 17:51:10 user nova-compute[75463]:   <os>
Nov 03 17:51:10 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:51:10 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:51:10 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:51:10 user nova-compute[75463]:   </os>
Nov 03 17:51:10 user nova-compute[75463]:   <features>
Nov 03 17:51:10 user nova-compute[75463]:     <acpi/>
Nov 03 17:51:10 user nova-compute[75463]:     <apic/>
Nov 03 17:51:10 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:51:10 user nova-compute[75463]:   </features>
Nov 03 17:51:10 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:51:10 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:51:10 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:51:10 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:51:10 user nova-compute[75463]:   </clock>
Nov 03 17:51:10 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:51:10 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:51:10 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:51:10 user nova-compute[75463]:   </cpu>
Nov 03 17:51:10 user nova-compute[75463]:   <devices>
Nov 03 17:51:10 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:51:10 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:51:10 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk"/>
Nov 03 17:51:10 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:51:10 user nova-compute[75463]:     </disk>
Nov 03 17:51:10 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:51:10 user nova-compute[75463]:       <mac address="fa:16:3e:ec:0a:ff"/>
Nov 03 17:51:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:51:10 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:51:10 user nova-compute[75463]:       <target dev="tapd820a593-b5"/>
Nov 03 17:51:10 user nova-compute[75463]:     </interface>
Nov 03 17:51:10 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:51:10 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/console.log" append="off"/>
Nov 03 17:51:10 user nova-compute[75463]:     </serial>
Nov 03 17:51:10 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:51:10 user nova-compute[75463]:     <video>
Nov 03 17:51:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:51:10 user nova-compute[75463]:     </video>
Nov 03 17:51:10 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:51:10 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:51:10 user nova-compute[75463]:     </rng>
Nov 03 17:51:10 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:51:10 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:51:10 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:51:10 user nova-compute[75463]:     </memballoon>
Nov 03 17:51:10 user nova-compute[75463]:   </devices>
Nov 03 17:51:10 user nova-compute[75463]: </domain>
Nov 03 17:51:10 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1317632656',display_name='tempest-AttachVolumeTestJSON-server-1317632656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1317632656',id=38,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9e6ov0G/vlYVlRMbXpaVjlcyqHPkBIxYAVFjPahymEIsYFOmrPW5G17B+/hs3p694rDSlohILB/tnG4voKIsJ7H7pVtE6xVjPLhKdaK8E2mdQOUjwWWixu1PsSorRCkw==',key_name='tempest-keypair-992452773',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-qgb5qsjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=e1b2f438-8a36-464d-b94e-c5f46f8e3704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG os_vif [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] Acquiring lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] No waiting events found dispatching network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:51:10 user nova-compute[75463]: WARNING nova.compute.manager [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received unexpected event network-vif-plugged-66456553-3fad-4dfa-936e-32a65ba84908 for instance with vm_state active and task_state deleting.
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-d35010c1-879e-4813-8e66-c87e35c3a6e7 req-2bb892c4-9e38-4980-aa6c-a17f5a99ee96 service nova] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Received event network-vif-deleted-66456553-3fad-4dfa-936e-32a65ba84908 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50560cee-b29c-5543-9a38-c72ae7762634', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd820a593-b5, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd820a593-b5, col_values=(('qos', UUID('deb3fa3e-fc9a-4580-a4b1-c058747185f4')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd820a593-b5, col_values=(('external_ids', {'iface-id': 'd820a593-b5d7-48f0-80b1-b4fcb7748d43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:0a:ff', 'vm-uuid': 'e1b2f438-8a36-464d-b94e-c5f46f8e3704'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:10 user nova-compute[75463]: INFO os_vif [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5')
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 894f53a5-925a-4f69-9478-53ac60dae0ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance d3bdc131-37c6-45dc-af53-d2aa5d2f7103 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No VIF found with MAC fa:16:3e:ec:0a:ff, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updated VIF entry in instance network info cache for port d820a593-b5d7-48f0-80b1-b4fcb7748d43. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating instance_info_cache with network_info: [{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:51:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ae7de7fa-971c-464e-a414-4f99053ed3fa req-aaa10214-78c6-4c0d-b6c0-299f03e812dc service nova] Releasing lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] No waiting events found dispatching network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:51:11 user nova-compute[75463]: WARNING nova.compute.manager [req-658e5c17-4667-41e3-a880-1e0d4fb54cab req-f10848f3-0bc2-4116-abb4-2a0133cdea57 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received unexpected event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 for instance with vm_state building and task_state spawning.
Nov 03 17:51:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:51:13 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Instance spawned successfully.
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:51:13 user nova-compute[75463]: INFO nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 03 17:51:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:51:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:51:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:14 user nova-compute[75463]: DEBUG nova.compute.manager [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] No waiting events found dispatching network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:51:14 user nova-compute[75463]: WARNING nova.compute.manager [req-f1a8557b-49ba-482f-a1fd-06d640200e45 req-a16888a8-94e6-4ded-8233-4deb88fac01a service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received unexpected event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 for instance with vm_state building and task_state spawning.
Nov 03 17:51:14 user nova-compute[75463]: INFO nova.compute.manager [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Took 6.99 seconds to build instance.
Nov 03 17:51:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f7b4853e-59a5-4da5-b551-1ec3dc587a24 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.118s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:17 user nova-compute[75463]: INFO nova.compute.manager [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 894f53a5-925a-4f69-9478-53ac60dae0ee] Took 7.57 seconds to detach 1 volumes for instance.
Nov 03 17:51:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:18 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:51:18 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:51:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:18 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance 894f53a5-925a-4f69-9478-53ac60dae0ee
Nov 03 17:51:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3197bb1a-3887-425d-840b-07bd41bcaac1 tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "894f53a5-925a-4f69-9478-53ac60dae0ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.588s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:51:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:51:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:51:59 user nova-compute[75463]: INFO nova.compute.claims [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Claim successful on node user
Nov 03 17:51:59 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:51:59 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:52:00 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.policy [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:52:00 user nova-compute[75463]: INFO nova.virt.block_device [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Booting with volume 379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 at /dev/vda
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.utils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a01d8-7e84-4c98-8ded-2a462afcea9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[20182afe-2544-4934-bf33-90108a9d6566]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7440a4-8e5a-4e13-917e-b3ac05bb24a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3188f313-0de6-478f-9193-b6996113e6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:52:00 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f2d1f-2a54-4eab-ad53-e42f447cfa9f]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG os_brick.utils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating existing volume attachment record: b657a52f-dfec-44b9-8260-6b797bee070b {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:00 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Successfully created port: da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Successfully updated port: da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing instance network info cache due to event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] Acquiring lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] Acquired lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing network info cache for port da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-61826d8c-33e7-4282-a5ba-77ed14eb373d req-274a5253-93a5-4965-b89b-f19e125944f2 service nova] Releasing lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:52:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:52:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating instance_info_cache with network_info: [{"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:52:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:52:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance network_info: |[{"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:52:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Skipping network cache update for instance because it is Building. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:52:05 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:52:06 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:52:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:52:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:12 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:52:12 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.213008880615234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance d3bdc131-37c6-45dc-af53-d2aa5d2f7103 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a0629ec4-70de-4fd6-b779-541d1212b19d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:52:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:52:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:52:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Creating image(s)
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Ensure instance console log exists: /opt/stack/data/nova/instances/a0629ec4-70de-4fd6-b779-541d1212b19d/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Start _get_guest_xml network_info=[{"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0629ec4-70de-4fd6-b779-541d1212b19d', 'attached_at': '', 'detached_at': '', 'volume_id': '379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'serial': '379d4ecb-1513-4250-8d3e-e7cf5bf4ad65'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'b657a52f-dfec-44b9-8260-6b797bee070b', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:52:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:52:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:52:21 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:52:21 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:52:21 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b91ad0d-3d74-4358-9ebc-62690c915a69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:52:21 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e18f4-9028-4abd-835d-d5e74df2c8b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65] added
Nov 03 17:52:21 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1b856-1af4-40fd-9679-07777bb6d79b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123a161-9133-477f-906a-cc785bb7f5b6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDVKXIAZ {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iDVKXIAZ" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad169b8-813a-4cba-84c6-0fd5cf36abc5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iDVKXIAZ'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[91634842-8b49-4230-bf40-f2e22d698f63]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c9630a-8a3c-415a-a47e-4172a5a3e9d5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:52:21 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:52:21 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:52:21 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:52:21 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:52:21 user nova-compute[75463]: 
Nov 03 17:52:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f826859-32a4-450c-8c2c-a1ac9c07d5fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]
Nov 03 17:52:22 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.
Nov 03 17:52:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82025ba5-238c-471b-8b09-3ff8171b04f2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b9a39-f25a-40ae-9aea-21ac0a879e07]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:52:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:52:22 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f38990-ab4a-4b0a-a10c-7e61bf9a76b9]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:52:22 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23139383338656136', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139383338656136', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-595186901',display_name='tempest-TestVolumeBootPattern-server-595186901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-595186901',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-qsytqp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:52:00Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a0629ec4-70de-4fd6-b779-541d1212b19d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'pci_devices' on Instance uuid a0629ec4-70de-4fd6-b779-541d1212b19d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:52:23 user nova-compute[75463]:   <uuid>a0629ec4-70de-4fd6-b779-541d1212b19d</uuid>
Nov 03 17:52:23 user nova-compute[75463]:   <name>instance-00000027</name>
Nov 03 17:52:23 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:52:23 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:52:23 user nova-compute[75463]:   <metadata>
Nov 03 17:52:23 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:52:23 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:52:23 user nova-compute[75463]:       <nova:name>tempest-TestVolumeBootPattern-server-595186901</nova:name>
Nov 03 17:52:23 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:52:21</nova:creationTime>
Nov 03 17:52:23 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:52:23 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:52:23 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:52:23 user nova-compute[75463]:       <nova:owner>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:user uuid="85b5595e7da047d9965cd795b2e6a83b">tempest-TestVolumeBootPattern-79691840-project-member</nova:user>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:project uuid="88d74abcd4a349ab96ba0f188542d61c">tempest-TestVolumeBootPattern-79691840</nova:project>
Nov 03 17:52:23 user nova-compute[75463]:       </nova:owner>
Nov 03 17:52:23 user nova-compute[75463]:       <nova:ports>
Nov 03 17:52:23 user nova-compute[75463]:         <nova:port uuid="da62c138-2fe9-4912-aa44-d8d717c0c039">
Nov 03 17:52:23 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:52:23 user nova-compute[75463]:         </nova:port>
Nov 03 17:52:23 user nova-compute[75463]:       </nova:ports>
Nov 03 17:52:23 user nova-compute[75463]:     </nova:instance>
Nov 03 17:52:23 user nova-compute[75463]:   </metadata>
Nov 03 17:52:23 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:52:23 user nova-compute[75463]:     <system>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="serial">a0629ec4-70de-4fd6-b779-541d1212b19d</entry>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="uuid">a0629ec4-70de-4fd6-b779-541d1212b19d</entry>
Nov 03 17:52:23 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:52:23 user nova-compute[75463]:     </system>
Nov 03 17:52:23 user nova-compute[75463]:   </sysinfo>
Nov 03 17:52:23 user nova-compute[75463]:   <os>
Nov 03 17:52:23 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:52:23 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:52:23 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:52:23 user nova-compute[75463]:   </os>
Nov 03 17:52:23 user nova-compute[75463]:   <features>
Nov 03 17:52:23 user nova-compute[75463]:     <acpi/>
Nov 03 17:52:23 user nova-compute[75463]:     <apic/>
Nov 03 17:52:23 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:52:23 user nova-compute[75463]:   </features>
Nov 03 17:52:23 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:52:23 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:52:23 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:52:23 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:52:23 user nova-compute[75463]:   </clock>
Nov 03 17:52:23 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:52:23 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:52:23 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:52:23 user nova-compute[75463]:   </cpu>
Nov 03 17:52:23 user nova-compute[75463]:   <devices>
Nov 03 17:52:23 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:52:23 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:52:23 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:52:23 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:52:23 user nova-compute[75463]:       <serial>379d4ecb-1513-4250-8d3e-e7cf5bf4ad65</serial>
Nov 03 17:52:23 user nova-compute[75463]:     </disk>
Nov 03 17:52:23 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:52:23 user nova-compute[75463]:       <mac address="fa:16:3e:89:f9:9c"/>
Nov 03 17:52:23 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:52:23 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:52:23 user nova-compute[75463]:       <target dev="tapda62c138-2f"/>
Nov 03 17:52:23 user nova-compute[75463]:     </interface>
Nov 03 17:52:23 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:52:23 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/a0629ec4-70de-4fd6-b779-541d1212b19d/console.log" append="off"/>
Nov 03 17:52:23 user nova-compute[75463]:     </serial>
Nov 03 17:52:23 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:52:23 user nova-compute[75463]:     <video>
Nov 03 17:52:23 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:52:23 user nova-compute[75463]:     </video>
Nov 03 17:52:23 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:52:23 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:52:23 user nova-compute[75463]:     </rng>
Nov 03 17:52:23 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:52:23 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:52:23 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:52:23 user nova-compute[75463]:     </memballoon>
Nov 03 17:52:23 user nova-compute[75463]:   </devices>
Nov 03 17:52:23 user nova-compute[75463]: </domain>
Nov 03 17:52:23 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-595186901',display_name='tempest-TestVolumeBootPattern-server-595186901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-595186901',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-qsytqp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:52:00Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a0629ec4-70de-4fd6-b779-541d1212b19d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG os_vif [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa32a3c4-c643-5350-8aed-bbd7a18cb067', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda62c138-2f, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda62c138-2f, col_values=(('qos', UUID('708987f5-1069-4126-9443-85c1caf271c8')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda62c138-2f, col_values=(('external_ids', {'iface-id': 'da62c138-2fe9-4912-aa44-d8d717c0c039', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:f9:9c', 'vm-uuid': 'a0629ec4-70de-4fd6-b779-541d1212b19d'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: INFO os_vif [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f')
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] No VIF found with MAC fa:16:3e:89:f9:9c, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:23 user nova-compute[75463]: INFO nova.compute.manager [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Terminating instance
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-unplugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] No waiting events found dispatching network-vif-unplugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e07365d-8314-4f3e-b7ff-9c53eea3a742 req-26d7b232-f8bd-4c50-b202-c4fa7dc8b2af service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-unplugged-62e335e0-6935-45e5-8762-5515ce671471 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:52:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Instance destroyed successfully.
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lazy-loading 'resources' on Instance uuid d3bdc131-37c6-45dc-af53-d2aa5d2f7103 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1586417069',display_name='tempest-VolumesActionsTest-instance-1586417069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1586417069',id=37,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-0ap2a1bb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:50:36Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=d3bdc131-37c6-45dc-af53-d2aa5d2f7103,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "62e335e0-6935-45e5-8762-5515ce671471", "address": "fa:16:3e:b2:9e:07", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e335e0-69", "ovs_interfaceid": "62e335e0-6935-45e5-8762-5515ce671471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG os_vif [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62e335e0-69, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fb70dc3-f060-4d8c-9c6f-27b9b42a8464) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: INFO os_vif [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9e:07,bridge_name='br-int',has_traffic_filtering=True,id=62e335e0-6935-45e5-8762-5515ce671471,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e335e0-69')
Nov 03 17:52:24 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Deleting instance files /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103_del
Nov 03 17:52:24 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Deletion of /opt/stack/data/nova/instances/d3bdc131-37c6-45dc-af53-d2aa5d2f7103_del complete
Nov 03 17:52:24 user nova-compute[75463]: INFO nova.compute.manager [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 03 17:52:24 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] No waiting events found dispatching network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:52:25 user nova-compute[75463]: WARNING nova.compute.manager [req-cdd6328c-173d-494b-bca9-875130fa2e94 req-831ab8fb-2eb6-45be-a3e7-89fe21dd3e82 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received unexpected event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 for instance with vm_state building and task_state spawning.
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:52:25 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Took 0.99 seconds to deallocate network for instance.
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] Acquiring lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] No waiting events found dispatching network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:52:25 user nova-compute[75463]: WARNING nova.compute.manager [req-186e47e2-3964-4557-b5a0-3f1302c6e89c req-9b1e46fa-5ca2-4f37-9cd6-ec4416bccd98 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received unexpected event network-vif-plugged-62e335e0-6935-45e5-8762-5515ce671471 for instance with vm_state deleted and task_state None.
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:52:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:25 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Deleted allocations for instance d3bdc131-37c6-45dc-af53-d2aa5d2f7103
Nov 03 17:52:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-05fa135e-76e4-4969-9b13-8be2d1b0a80c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "d3bdc131-37c6-45dc-af53-d2aa5d2f7103" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.619s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:52:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance spawned successfully.
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:52:27 user nova-compute[75463]: INFO nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:52:27 user nova-compute[75463]: INFO nova.compute.manager [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Took 27.58 seconds to build instance.
Nov 03 17:52:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-174b0edb-6019-4504-8c84-721f3b0c86db tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.678s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] [instance: d3bdc131-37c6-45dc-af53-d2aa5d2f7103] Received event network-vif-deleted-62e335e0-6935-45e5-8762-5515ce671471 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:52:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] No waiting events found dispatching network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:52:27 user nova-compute[75463]: WARNING nova.compute.manager [req-b17341ee-19d3-45ce-b9d7-c01904dc6f56 req-5e4e35ce-dc74-4e1b-9078-a239c4b005d3 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received unexpected event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 for instance with vm_state active and task_state None.
Nov 03 17:52:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:52:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:52:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-changed-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG nova.compute.manager [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Refreshing instance network info cache due to event network-changed-d820a593-b5d7-48f0-80b1-b4fcb7748d43. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] Acquiring lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] Acquired lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG nova.network.neutron [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Refreshing network info cache for port d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:52:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:52:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updated VIF entry in instance network info cache for port d820a593-b5d7-48f0-80b1-b4fcb7748d43. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:52:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating instance_info_cache with network_info: [{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:52:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5831b913-a7e7-46b9-8e29-db5b227ee33d req-c468c13a-5a73-46a5-a6f6-42303be632c9 service nova] Releasing lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:52:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:01 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:03 user nova-compute[75463]: INFO nova.compute.manager [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attaching volume e1453999-48a8-49f4-a64c-69972bf5c5fd to /dev/vdb
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a11a1-15c3-4bc4-9bd9-eec4b88fb1a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d476b-70cb-4139-8b8b-c105c97539fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd1c461-d0bb-482c-a4db-28352be5917f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e5e9c-a485-4cbe-b566-52066f5d18f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:53:03 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:53:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8634e-3fe7-4ab2-8d5b-a82985e8a4c0]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:53:03 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating existing volume attachment record: 057ff350-ab87-4584-abd1-8990c643c7e6 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:53:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:53:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:08 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:53:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:11 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:11 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:11 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=25.237964630126953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a0629ec4-70de-4fd6-b779-541d1212b19d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:53:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:53:15 user nova-compute[75463]: INFO nova.compute.claims [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Claim successful on node user
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:53:15 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.policy [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8898fdead75544f38f127638944e9610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe62e0bcc91646989f6433e3692f0dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:53:15 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Creating image(s)
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "/opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "/opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Successfully created port: 581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk 1073741824" returned: 0 in 0.055s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Cannot resize image /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Ensure instance console log exists: /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Successfully updated port: 581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquired lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.compute.manager [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-changed-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.compute.manager [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Refreshing instance network info cache due to event network-changed-581a79f9-3b85-4876-8364-e669d96b1245. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] Acquiring lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Updating instance_info_cache with network_info: [{"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Releasing lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Instance network_info: |[{"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] Acquired lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Refreshing network info cache for port 581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Start _get_guest_xml network_info=[{"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:53:17 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:17 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1177760014',display_name='tempest-VolumesActionsTest-instance-1177760014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1177760014',id=40,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-os23impl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:53:16Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=8a6452e2-e9e0-4dff-be0a-3df4450d230e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.objects.instance [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a6452e2-e9e0-4dff-be0a-3df4450d230e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:53:17 user nova-compute[75463]:   <uuid>8a6452e2-e9e0-4dff-be0a-3df4450d230e</uuid>
Nov 03 17:53:17 user nova-compute[75463]:   <name>instance-00000028</name>
Nov 03 17:53:17 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:53:17 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:53:17 user nova-compute[75463]:   <metadata>
Nov 03 17:53:17 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:53:17 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:name>tempest-VolumesActionsTest-instance-1177760014</nova:name>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:53:17</nova:creationTime>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:53:17 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:53:17 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:owner>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:user uuid="8898fdead75544f38f127638944e9610">tempest-VolumesActionsTest-136348732-project-member</nova:user>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:project uuid="fe62e0bcc91646989f6433e3692f0dfe">tempest-VolumesActionsTest-136348732</nova:project>
Nov 03 17:53:17 user nova-compute[75463]:       </nova:owner>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:53:17 user nova-compute[75463]:       <nova:ports>
Nov 03 17:53:17 user nova-compute[75463]:         <nova:port uuid="581a79f9-3b85-4876-8364-e669d96b1245">
Nov 03 17:53:17 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 03 17:53:17 user nova-compute[75463]:         </nova:port>
Nov 03 17:53:17 user nova-compute[75463]:       </nova:ports>
Nov 03 17:53:17 user nova-compute[75463]:     </nova:instance>
Nov 03 17:53:17 user nova-compute[75463]:   </metadata>
Nov 03 17:53:17 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:53:17 user nova-compute[75463]:     <system>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="serial">8a6452e2-e9e0-4dff-be0a-3df4450d230e</entry>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="uuid">8a6452e2-e9e0-4dff-be0a-3df4450d230e</entry>
Nov 03 17:53:17 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:53:17 user nova-compute[75463]:     </system>
Nov 03 17:53:17 user nova-compute[75463]:   </sysinfo>
Nov 03 17:53:17 user nova-compute[75463]:   <os>
Nov 03 17:53:17 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:53:17 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:53:17 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:53:17 user nova-compute[75463]:   </os>
Nov 03 17:53:17 user nova-compute[75463]:   <features>
Nov 03 17:53:17 user nova-compute[75463]:     <acpi/>
Nov 03 17:53:17 user nova-compute[75463]:     <apic/>
Nov 03 17:53:17 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:53:17 user nova-compute[75463]:   </features>
Nov 03 17:53:17 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:53:17 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:53:17 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:53:17 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:53:17 user nova-compute[75463]:   </clock>
Nov 03 17:53:17 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:53:17 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:53:17 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:53:17 user nova-compute[75463]:   </cpu>
Nov 03 17:53:17 user nova-compute[75463]:   <devices>
Nov 03 17:53:17 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:53:17 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:53:17 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk"/>
Nov 03 17:53:17 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:53:17 user nova-compute[75463]:     </disk>
Nov 03 17:53:17 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:53:17 user nova-compute[75463]:       <mac address="fa:16:3e:54:60:77"/>
Nov 03 17:53:17 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:53:17 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:53:17 user nova-compute[75463]:       <target dev="tap581a79f9-3b"/>
Nov 03 17:53:17 user nova-compute[75463]:     </interface>
Nov 03 17:53:17 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:53:17 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/console.log" append="off"/>
Nov 03 17:53:17 user nova-compute[75463]:     </serial>
Nov 03 17:53:17 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:53:17 user nova-compute[75463]:     <video>
Nov 03 17:53:17 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:53:17 user nova-compute[75463]:     </video>
Nov 03 17:53:17 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:53:17 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:53:17 user nova-compute[75463]:     </rng>
Nov 03 17:53:17 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:53:17 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:53:17 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:53:17 user nova-compute[75463]:     </memballoon>
Nov 03 17:53:17 user nova-compute[75463]:   </devices>
Nov 03 17:53:17 user nova-compute[75463]: </domain>
Nov 03 17:53:17 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1177760014',display_name='tempest-VolumesActionsTest-instance-1177760014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1177760014',id=40,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-os23impl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:53:16Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=8a6452e2-e9e0-4dff-be0a-3df4450d230e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG os_vif [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5942f69-02f0-569a-9350-bfb445104647', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap581a79f9-3b, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap581a79f9-3b, col_values=(('qos', UUID('0b990d87-e41b-4301-a3ae-6994d3b867c9')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap581a79f9-3b, col_values=(('external_ids', {'iface-id': '581a79f9-3b85-4876-8364-e669d96b1245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:60:77', 'vm-uuid': '8a6452e2-e9e0-4dff-be0a-3df4450d230e'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:17 user nova-compute[75463]: INFO os_vif [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b')
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] No VIF found with MAC fa:16:3e:54:60:77, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Updated VIF entry in instance network info cache for port 581a79f9-3b85-4876-8364-e669d96b1245. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Updating instance_info_cache with network_info: [{"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-805457da-63be-43cb-b9ff-2e99a4f2de16 req-48ab5cb0-ac0e-487c-8600-791316b6b856 service nova] Releasing lock "refresh_cache-8a6452e2-e9e0-4dff-be0a-3df4450d230e" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] No waiting events found dispatching network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:53:19 user nova-compute[75463]: WARNING nova.compute.manager [req-88fd4841-b890-4939-868a-e76f60f95e56 req-47bc018a-b756-4ebd-b670-901156376b3a service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received unexpected event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 for instance with vm_state building and task_state spawning.
Nov 03 17:53:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:53:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Instance spawned successfully.
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] No waiting events found dispatching network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:53:21 user nova-compute[75463]: WARNING nova.compute.manager [req-9e56ef95-8570-4c46-8fae-91fd4e74eccc req-fcf3d5b8-20bc-453c-b004-0de871ee5c4d service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received unexpected event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 for instance with vm_state building and task_state spawning.
Nov 03 17:53:21 user nova-compute[75463]: INFO nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 03 17:53:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:53:21 user nova-compute[75463]: INFO nova.compute.manager [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Took 6.00 seconds to build instance.
Nov 03 17:53:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fa4f7aff-b4b1-47cb-b25f-a6d37a97ca76 tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.095s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZTCPSfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:53:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:53:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:53:26 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f3f93-0b88-432e-b950-a2169d1a72d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:53:26 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd946d48-9d70-4bbd-9f96-f239cff43994]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd] added
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b619df-9196-4543-8e8f-aeb2ef71c2bb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac152e8-e4fe-43a1-8822-f59ef5af5eb9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZTCPSfE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZTCPSfE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c2cb42-f216-4c90-840a-d1fc03a05394]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NZTCPSfE'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a68e2-d6e7-405d-b3e0-f6ca42351965]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37f494f-47aa-4f63-a0e0-8735daccf71f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[97908a1a-c9be-4e6a-b1db-2b0a658fe48f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260]
Nov 03 17:53:26 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260] successful.
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d5251-ebe6-4f44-b8d9-44ac369b1a5d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209892f-e68f-45ab-97d6-d7d01e623de7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:26 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:26 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:26 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62692ec7-a3f4-437d-b0f1-14828c391963]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:53:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZTCPSfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23930326333313939', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930326333313939', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG nova.objects.instance [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:53:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:53:27 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:53:27 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:53:27 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:53:27 user nova-compute[75463]:   <serial>e1453999-48a8-49f4-a64c-69972bf5c5fd</serial>
Nov 03 17:53:27 user nova-compute[75463]: </disk>
Nov 03 17:53:27 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:53:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:53:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:53:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No VIF found with MAC fa:16:3e:ec:0a:ff, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:53:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dd4631e4-b25c-4dc6-b3ed-00e6215c798e tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.833s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:53:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.252s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:34 user nova-compute[75463]: INFO nova.compute.manager [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attaching volume cea60678-5ca6-4fc7-a612-850ab1c4ea07 to /dev/vdc
Nov 03 17:53:34 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b5c4e-4547-4631-b7ec-c08f585e7939]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0bde8-4fbc-4905-b36a-08dcee769efd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba4385-cb88-4f30-b440-d9ced12e1c10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[58112e2f-7f07-44fe-bff0-16f3fd68a81a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:53:35 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:53:35 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be68bc3-87cb-40cc-964b-be86af3ff4f2]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG os_brick.utils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:53:35 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating existing volume attachment record: d0d3f4d5-0cae-485b-9705-de7b60631ba0 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:53:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing instance network info cache due to event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] Acquiring lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] Acquired lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG nova.network.neutron [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing network info cache for port da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:53:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updated VIF entry in instance network info cache for port da62c138-2fe9-4912-aa44-d8d717c0c039. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:53:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating instance_info_cache with network_info: [{"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-763cded6-0a17-4ed5-a8ec-b3797f625051 req-5b11410f-6c6b-4a08-93f8-7b088c364380 service nova] Releasing lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:54 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:53:54 user nova-compute[75463]: INFO nova.compute.claims [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Claim successful on node user
Nov 03 17:53:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:53:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:53:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Creating image(s)
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "/opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "/opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "/opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG nova.policy [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b68f632f47403cbd0bc07a1bc6f262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058766f9c1614db6b3a88c8dbafa1f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk 1073741824" returned: 0 in 0.055s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Cannot resize image /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Ensure instance console log exists: /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:53:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:53:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:57 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Successfully created port: b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:53:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Successfully updated port: b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquired lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-changed-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Refreshing instance network info cache due to event network-changed-b3455bf3-4151-408b-8ac7-d25207918c93. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] Acquiring lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.neutron [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating instance_info_cache with network_info: [{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Releasing lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Instance network_info: |[{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] Acquired lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.neutron [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Refreshing network info cache for port b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Start _get_guest_xml network_info=[{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:53:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:58 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8898953',id=41,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNejgbIeEt8mP0PXk7vfHA3YckHxDvG+MejbHsQP1xI6t3omMiWxiS68FEukWlCj1Im3ya76YSVFt0Beoq+zo06kR7eK+MB1h+tZtHR+fV7Qtas1Mt5DA7a+4JQXkFcFOA==',key_name='tempest-keypair-1977038688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='058766f9c1614db6b3a88c8dbafa1f0c',ramdisk_id='',reservation_id='r-5qykkifq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b68f632f47403cbd0bc07a1bc6f262',uuid=17378cbe-33d0-4aa4-a2fc-0cd6619e1054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converting VIF {"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lazy-loading 'pci_devices' on Instance uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:53:58 user nova-compute[75463]:   <uuid>17378cbe-33d0-4aa4-a2fc-0cd6619e1054</uuid>
Nov 03 17:53:58 user nova-compute[75463]:   <name>instance-00000029</name>
Nov 03 17:53:58 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:53:58 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:53:58 user nova-compute[75463]:   <metadata>
Nov 03 17:53:58 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:53:58 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382</nova:name>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:53:58</nova:creationTime>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:53:58 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:53:58 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:owner>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:user uuid="54b68f632f47403cbd0bc07a1bc6f262">tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member</nova:user>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:project uuid="058766f9c1614db6b3a88c8dbafa1f0c">tempest-TestServerVolumeAttachScenarioOldVersion-1715016178</nova:project>
Nov 03 17:53:58 user nova-compute[75463]:       </nova:owner>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:53:58 user nova-compute[75463]:       <nova:ports>
Nov 03 17:53:58 user nova-compute[75463]:         <nova:port uuid="b3455bf3-4151-408b-8ac7-d25207918c93">
Nov 03 17:53:58 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 03 17:53:58 user nova-compute[75463]:         </nova:port>
Nov 03 17:53:58 user nova-compute[75463]:       </nova:ports>
Nov 03 17:53:58 user nova-compute[75463]:     </nova:instance>
Nov 03 17:53:58 user nova-compute[75463]:   </metadata>
Nov 03 17:53:58 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:53:58 user nova-compute[75463]:     <system>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="serial">17378cbe-33d0-4aa4-a2fc-0cd6619e1054</entry>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="uuid">17378cbe-33d0-4aa4-a2fc-0cd6619e1054</entry>
Nov 03 17:53:58 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:53:58 user nova-compute[75463]:     </system>
Nov 03 17:53:58 user nova-compute[75463]:   </sysinfo>
Nov 03 17:53:58 user nova-compute[75463]:   <os>
Nov 03 17:53:58 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:53:58 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:53:58 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:53:58 user nova-compute[75463]:   </os>
Nov 03 17:53:58 user nova-compute[75463]:   <features>
Nov 03 17:53:58 user nova-compute[75463]:     <acpi/>
Nov 03 17:53:58 user nova-compute[75463]:     <apic/>
Nov 03 17:53:58 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:53:58 user nova-compute[75463]:   </features>
Nov 03 17:53:58 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:53:58 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:53:58 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:53:58 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:53:58 user nova-compute[75463]:   </clock>
Nov 03 17:53:58 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:53:58 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:53:58 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:53:58 user nova-compute[75463]:   </cpu>
Nov 03 17:53:58 user nova-compute[75463]:   <devices>
Nov 03 17:53:58 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:53:58 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:53:58 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk"/>
Nov 03 17:53:58 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:53:58 user nova-compute[75463]:     </disk>
Nov 03 17:53:58 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:53:58 user nova-compute[75463]:       <mac address="fa:16:3e:be:65:df"/>
Nov 03 17:53:58 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:53:58 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:53:58 user nova-compute[75463]:       <target dev="tapb3455bf3-41"/>
Nov 03 17:53:58 user nova-compute[75463]:     </interface>
Nov 03 17:53:58 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:53:58 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/console.log" append="off"/>
Nov 03 17:53:58 user nova-compute[75463]:     </serial>
Nov 03 17:53:58 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:53:58 user nova-compute[75463]:     <video>
Nov 03 17:53:58 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:53:58 user nova-compute[75463]:     </video>
Nov 03 17:53:58 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:53:58 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:53:58 user nova-compute[75463]:     </rng>
Nov 03 17:53:58 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:53:58 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:53:58 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:53:58 user nova-compute[75463]:     </memballoon>
Nov 03 17:53:58 user nova-compute[75463]:   </devices>
Nov 03 17:53:58 user nova-compute[75463]: </domain>
Nov 03 17:53:58 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8898953',id=41,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNejgbIeEt8mP0PXk7vfHA3YckHxDvG+MejbHsQP1xI6t3omMiWxiS68FEukWlCj1Im3ya76YSVFt0Beoq+zo06kR7eK+MB1h+tZtHR+fV7Qtas1Mt5DA7a+4JQXkFcFOA==',key_name='tempest-keypair-1977038688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='058766f9c1614db6b3a88c8dbafa1f0c',ramdisk_id='',reservation_id='r-5qykkifq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b68f632f47403cbd0bc07a1bc6f262',uuid=17378cbe-33d0-4aa4-a2fc-0cd6619e1054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converting VIF {"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_vif [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd76705f-e4cb-5c22-af1b-34397ce57f3d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3455bf3-41, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3455bf3-41, col_values=(('qos', UUID('ea0aa28e-2b17-47e0-a190-c9fcf44a558b')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3455bf3-41, col_values=(('external_ids', {'iface-id': 'b3455bf3-4151-408b-8ac7-d25207918c93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:65:df', 'vm-uuid': '17378cbe-33d0-4aa4-a2fc-0cd6619e1054'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:53:58 user nova-compute[75463]: INFO os_vif [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41')
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] No VIF found with MAC fa:16:3e:be:65:df, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElGroazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:53:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:53:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:53:58 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0270079-cd38-448b-816e-af836e950e81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:53:58 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1cffc2-89c1-4729-9d86-e25c8937d4d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07] added
Nov 03 17:53:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c600a-374d-4c25-8eda-7daeb34918ed]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a8884-7afd-432e-9a1e-dd0a12dcacd0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElGroazt {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElGroazt" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93bee8-f45a-4909-a88e-147b347e07ad]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ElGroazt'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3128da90-7e90-44a2-9a58-e442d889893f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c907d39-535d-4566-ba44-9a456ee0c1e4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updated VIF entry in instance network info cache for port b3455bf3-4151-408b-8ac7-d25207918c93. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG nova.network.neutron [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating instance_info_cache with network_info: [{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48ebe7-a7a7-4bd1-8160-a26eaaeed083]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260]
Nov 03 17:53:59 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260] successful.
Nov 03 17:53:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eac2e228-2f58-4d51-a1dc-f43c3e389a82 req-8c777a6a-51f8-4cb3-ad40-66c9dbf1e4a7 service nova] Releasing lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6670071-c45e-4918-b7a5-cfa5447bebc0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b4fbde-fabb-4af1-8c9b-c2cf56424dec]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:53:59 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:53:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[678841e2-3311-4b76-8bbc-44096a973992]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:53:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElGroazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23463313030306232', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463313030306232', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:54:00 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:54:00 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:54:00 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 17:54:00 user nova-compute[75463]:   <serial>cea60678-5ca6-4fc7-a612-850ab1c4ea07</serial>
Nov 03 17:54:00 user nova-compute[75463]: </disk>
Nov 03 17:54:00 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] No waiting events found dispatching network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:00 user nova-compute[75463]: WARNING nova.compute.manager [req-180451d5-7d54-4a13-8d43-2a8326318c38 req-56710114-319e-40d6-97dd-b0616f9b291a service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received unexpected event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 for instance with vm_state building and task_state spawning.
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] No VIF found with MAC fa:16:3e:ec:0a:ff, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:00 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:54:00 user nova-compute[75463]: INFO nova.compute.claims [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Claim successful on node user
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7f3f2b8b-7d18-49ef-ad89-c964f5623a30 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.218s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:54:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.policy [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3917b2874c454ef39166a58e155bba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e79281ae1b44bdbd88ca10c3cc2c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:54:01 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Creating image(s)
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "/opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "/opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk 1073741824" returned: 0 in 0.050s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:01 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Successfully created port: 07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.compute.manager [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] No waiting events found dispatching network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:02 user nova-compute[75463]: WARNING nova.compute.manager [req-ac372e38-6230-4c75-a1df-d15edcb90011 req-7b97c3d3-4819-4e99-90c7-b24a4736ec26 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received unexpected event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 for instance with vm_state building and task_state spawning.
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:02 user nova-compute[75463]: INFO nova.compute.manager [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Detaching volume e1453999-48a8-49f4-a64c-69972bf5c5fd
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:02 user nova-compute[75463]: INFO nova.virt.block_device [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attempting to driver detach volume e1453999-48a8-49f4-a64c-69972bf5c5fd from mountpoint /dev/vdb
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Attempting to detach device vdb from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:54:02 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:54:02 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:54:02 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:54:02 user nova-compute[75463]:   <serial>e1453999-48a8-49f4-a64c-69972bf5c5fd</serial>
Nov 03 17:54:02 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:54:02 user nova-compute[75463]: </disk>
Nov 03 17:54:02 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:54:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully detached device vdb from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the persistent domain config.
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:54:02 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:54:02 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:54:02 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:54:02 user nova-compute[75463]:   <serial>e1453999-48a8-49f4-a64c-69972bf5c5fd</serial>
Nov 03 17:54:02 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:54:02 user nova-compute[75463]: </disk>
Nov 03 17:54:02 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:54:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Instance spawned successfully.
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:02 user nova-compute[75463]: INFO nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 03 17:54:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Successfully updated port: 07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:54:03 user nova-compute[75463]: INFO nova.compute.manager [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Took 8.09 seconds to build instance.
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e388ada5-94c5-4b69-b06a-069c26c2c9c3 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.194s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing instance network info cache due to event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Instance network_info: |[{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Start _get_guest_xml network_info=[{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:54:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:54:03 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1612767726',display_name='tempest-TestStampPattern-server-1612767726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1612767726',id=42,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-s108x7v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:54:01Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=2bf1471d-815e-4db6-bd76-39f19d901359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:54:03 user nova-compute[75463]:   <uuid>2bf1471d-815e-4db6-bd76-39f19d901359</uuid>
Nov 03 17:54:03 user nova-compute[75463]:   <name>instance-0000002a</name>
Nov 03 17:54:03 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:54:03 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:54:03 user nova-compute[75463]:   <metadata>
Nov 03 17:54:03 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:54:03 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:name>tempest-TestStampPattern-server-1612767726</nova:name>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:54:03</nova:creationTime>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:54:03 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:54:03 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:owner>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:user uuid="3917b2874c454ef39166a58e155bba9d">tempest-TestStampPattern-1270453444-project-member</nova:user>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:project uuid="45e79281ae1b44bdbd88ca10c3cc2c89">tempest-TestStampPattern-1270453444</nova:project>
Nov 03 17:54:03 user nova-compute[75463]:       </nova:owner>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:54:03 user nova-compute[75463]:       <nova:ports>
Nov 03 17:54:03 user nova-compute[75463]:         <nova:port uuid="07eb9fa9-3eee-443b-93a9-6be26091c599">
Nov 03 17:54:03 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 17:54:03 user nova-compute[75463]:         </nova:port>
Nov 03 17:54:03 user nova-compute[75463]:       </nova:ports>
Nov 03 17:54:03 user nova-compute[75463]:     </nova:instance>
Nov 03 17:54:03 user nova-compute[75463]:   </metadata>
Nov 03 17:54:03 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:54:03 user nova-compute[75463]:     <system>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="serial">2bf1471d-815e-4db6-bd76-39f19d901359</entry>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="uuid">2bf1471d-815e-4db6-bd76-39f19d901359</entry>
Nov 03 17:54:03 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:54:03 user nova-compute[75463]:     </system>
Nov 03 17:54:03 user nova-compute[75463]:   </sysinfo>
Nov 03 17:54:03 user nova-compute[75463]:   <os>
Nov 03 17:54:03 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:54:03 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:54:03 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:54:03 user nova-compute[75463]:   </os>
Nov 03 17:54:03 user nova-compute[75463]:   <features>
Nov 03 17:54:03 user nova-compute[75463]:     <acpi/>
Nov 03 17:54:03 user nova-compute[75463]:     <apic/>
Nov 03 17:54:03 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:54:03 user nova-compute[75463]:   </features>
Nov 03 17:54:03 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:54:03 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:54:03 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:54:03 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:54:03 user nova-compute[75463]:   </clock>
Nov 03 17:54:03 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:54:03 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:54:03 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:54:03 user nova-compute[75463]:   </cpu>
Nov 03 17:54:03 user nova-compute[75463]:   <devices>
Nov 03 17:54:03 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:54:03 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:54:03 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk"/>
Nov 03 17:54:03 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:54:03 user nova-compute[75463]:     </disk>
Nov 03 17:54:03 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:54:03 user nova-compute[75463]:       <mac address="fa:16:3e:db:bb:b3"/>
Nov 03 17:54:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:54:03 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:54:03 user nova-compute[75463]:       <target dev="tap07eb9fa9-3e"/>
Nov 03 17:54:03 user nova-compute[75463]:     </interface>
Nov 03 17:54:03 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:54:03 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/console.log" append="off"/>
Nov 03 17:54:03 user nova-compute[75463]:     </serial>
Nov 03 17:54:03 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:54:03 user nova-compute[75463]:     <video>
Nov 03 17:54:03 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:54:03 user nova-compute[75463]:     </video>
Nov 03 17:54:03 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:54:03 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:54:03 user nova-compute[75463]:     </rng>
Nov 03 17:54:03 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:54:03 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:54:03 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:54:03 user nova-compute[75463]:     </memballoon>
Nov 03 17:54:03 user nova-compute[75463]:   </devices>
Nov 03 17:54:03 user nova-compute[75463]: </domain>
Nov 03 17:54:03 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1612767726',display_name='tempest-TestStampPattern-server-1612767726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1612767726',id=42,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-s108x7v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:54:01Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=2bf1471d-815e-4db6-bd76-39f19d901359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG os_vif [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1392cfe5-d533-57c3-9689-1fe867e1e28d', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07eb9fa9-3e, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07eb9fa9-3e, col_values=(('qos', UUID('cc7bdc94-ebe1-4c1c-afee-d6e3c0c06efd')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07eb9fa9-3e, col_values=(('external_ids', {'iface-id': '07eb9fa9-3eee-443b-93a9-6be26091c599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:bb:b3', 'vm-uuid': '2bf1471d-815e-4db6-bd76-39f19d901359'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:03 user nova-compute[75463]: INFO os_vif [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e')
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No VIF found with MAC fa:16:3e:db:bb:b3, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updated VIF entry in instance network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a3dc4acc-13c4-47fe-be1c-1939c13b1c5f req-36353430-f9b9-4858-ba0f-3baf8f939b4f service nova] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:54:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:05 user nova-compute[75463]: WARNING nova.compute.manager [req-45f9e6b4-abb6-4741-80e1-c1b1e8a3691f req-3ad7bfef-9fa3-457c-8323-df5b797225dd service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state building and task_state spawning.
Nov 03 17:54:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:54:07 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Instance spawned successfully.
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:07 user nova-compute[75463]: WARNING nova.compute.manager [req-c8271354-dfba-43f1-833d-04bec0962cbe req-62b07a98-f12d-4fee-ae0f-7bdb41208ea4 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state building and task_state spawning.
Nov 03 17:54:07 user nova-compute[75463]: INFO nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 03 17:54:07 user nova-compute[75463]: DEBUG nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:54:07 user nova-compute[75463]: INFO nova.compute.manager [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Took 6.47 seconds to build instance.
Nov 03 17:54:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-380e3785-e3ff-4956-bc69-5c1353117710 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.629s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:54:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:54:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:54:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:54:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating instance_info_cache with network_info: [{"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-e1b2f438-8a36-464d-b94e-c5f46f8e3704" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:54:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:54:12 user nova-compute[75463]: INFO nova.compute.claims [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Claim successful on node user
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:54:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG nova.policy [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b5595e7da047d9965cd795b2e6a83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88d74abcd4a349ab96ba0f188542d61c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:54:12 user nova-compute[75463]: INFO nova.virt.block_device [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Booting with volume 0156e99a-d508-4db4-ae94-0a7d1fee77bd at /dev/vda
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG os_brick.utils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12766df-61f3-4802-b2ac-38aa39e78214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00dbd4-8352-4d91-b50e-e4c7f5b8f3ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:12 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097fc78-33d0-40ea-b321-dc07a9de06ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652c973-e89c-454a-bcea-5d2cd0a2f32e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:54:13 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b8fa4-8e95-4f5b-a737-a183498eeb18]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG os_brick.utils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Updating existing volume attachment record: 260deaad-2852-409b-9bf1-dfab8d39793b {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Successfully created port: 8e9bdaa9-425c-46bb-aec6-8a07aa16a18b {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:54:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:54:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8343MB free_disk=25.17849349975586GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a0629ec4-70de-4fd6-b779-541d1212b19d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 8a6452e2-e9e0-4dff-be0a-3df4450d230e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Successfully updated port: 8e9bdaa9-425c-46bb-aec6-8a07aa16a18b {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquired lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Received event network-changed-8e9bdaa9-425c-46bb-aec6-8a07aa16a18b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Refreshing instance network info cache due to event network-changed-8e9bdaa9-425c-46bb-aec6-8a07aa16a18b. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] Acquiring lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Updating instance_info_cache with network_info: [{"id": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "address": "fa:16:3e:11:6a:24", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9bdaa9-42", "ovs_interfaceid": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Releasing lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Instance network_info: |[{"id": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "address": "fa:16:3e:11:6a:24", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9bdaa9-42", "ovs_interfaceid": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] Acquired lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Refreshing network info cache for port 8e9bdaa9-425c-46bb-aec6-8a07aa16a18b {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Updated VIF entry in instance network info cache for port 8e9bdaa9-425c-46bb-aec6-8a07aa16a18b. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Updating instance_info_cache with network_info: [{"id": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "address": "fa:16:3e:11:6a:24", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9bdaa9-42", "ovs_interfaceid": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4f380332-9c23-4bb2-8085-6b153fc6566e req-3a608ca3-f40b-4f7d-bdbd-0743bce86680 service nova] Releasing lock "refresh_cache-64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:54:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:23 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 is timed out.
Nov 03 17:54:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully detached device vdb from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the live domain config.
Nov 03 17:54:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZTCPSfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:54:23 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e553c-5b3f-4a04-a937-c8e23c6dd898]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:54:23 user nova-compute[75463]: No targets found.
Nov 03 17:54:23 user nova-compute[75463]: iSNS:
Nov 03 17:54:23 user nova-compute[75463]: No targets found.
Nov 03 17:54:23 user nova-compute[75463]: STATIC:
Nov 03 17:54:23 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:54:23 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:54:23 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:54:23 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07
Nov 03 17:54:23 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:54:23 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:54:23 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd
Nov 03 17:54:23 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:54:23 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:54:23 user nova-compute[75463]: FIRMWARE:
Nov 03 17:54:23 user nova-compute[75463]: No targets found.
Nov 03 17:54:23 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:54:23 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:54:23 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d498d7e7-1c4c-4282-a13c-fcd59c9dea45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ee0000-c137-469b-b386-5520c4949a46]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:54:23 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:54:23 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:54:23 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:54:23 user nova-compute[75463]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd (non-flash)
Nov 03 17:54:23 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:54:23 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec420f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa687d2b-35cc-486e-bdb7-add725239483]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c5397-ca42-43d1-867e-beccafeaf106]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d291a54-901f-4115-be08-e346d00fc8f6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961a245-2662-4a92-be1b-8eabdb8ba955]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[42281647-4592-44a7-a50a-43b3d931f7e6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3914c2c-2718-4118-be06-f29c221456c9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260]
Nov 03 17:54:23 user nova-compute[75463]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd, portal: 172.16.0.220,3260] successful.
Nov 03 17:54:23 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1453999-48a8-49f4-a64c-69972bf5c5fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1b8363-610e-4d7a-82b1-375e80603b82]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== disconnect_volume: return (321ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:54:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0bf29956-fe7d-4ef3-87a9-dc8db6b49365 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.volume.cinder [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Update attachment failed for attachment 260deaad-2852-409b-9bf1-dfab8d39793b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Traceback (most recent call last):
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     driver_block_device.attach_block_devices(
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     _log_and_attach(device)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     bdm.attach(*attach_args, **attach_kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     ret_val = method(obj, context, *args, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     self._do_attach(context, instance, volume, volume_api,
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     self._volume_attach(context, volume, connector, instance,
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     connection_info = volume_api.attachment_update(
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     res = method(self, ctx, *args, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     with excutils.save_and_reraise_exception():
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     self.force_reraise()
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     raise self.value
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     context, '3.44', skip_version_check=True).attachments.update(
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     return method.func(obj, *args, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     resp = self._update('/attachments/%s' % id, body)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     return self._cs_request(url, 'PUT', **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     return self.request(url, method, **kwargs)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c]     raise exceptions.from_response(resp, body)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c)
Nov 03 17:54:24 user nova-compute[75463]: ERROR nova.compute.manager [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] 
Nov 03 17:54:24 user nova-compute[75463]: DEBUG nova.compute.claims [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Aborting claim: <nova.compute.claims.Claim object at 0x7fe0141dc550> {{(pid=75463) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:54:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.285s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Build of instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c) {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.utils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Build of instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75463) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 03 17:54:25 user nova-compute[75463]: ERROR nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Build of instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c): nova.exception.BuildAbortException: Build of instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-13ad8230-c673-4a1e-9a3c-97cf3bdeaa7c)
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Unplugging VIFs for instance {{(pid=75463) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1900191898',display_name='tempest-TestVolumeBootPattern-server-1900191898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1900191898',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-5rv6azji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:54:13Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=64c624a1-3b7f-480d-bea1-43a9b2bc7a6c,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "address": "fa:16:3e:11:6a:24", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9bdaa9-42", "ovs_interfaceid": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "address": "fa:16:3e:11:6a:24", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9bdaa9-42", "ovs_interfaceid": "8e9bdaa9-425c-46bb-aec6-8a07aa16a18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:6a:24,bridge_name='br-int',has_traffic_filtering=True,id=8e9bdaa9-425c-46bb-aec6-8a07aa16a18b,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9bdaa9-42') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG os_vif [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:6a:24,bridge_name='br-int',has_traffic_filtering=True,id=8e9bdaa9-425c-46bb-aec6-8a07aa16a18b,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9bdaa9-42') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e9bdaa9-42, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:54:25 user nova-compute[75463]: INFO os_vif [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:6a:24,bridge_name='br-int',has_traffic_filtering=True,id=8e9bdaa9-425c-46bb-aec6-8a07aa16a18b,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9bdaa9-42')
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Unplugged VIFs for instance {{(pid=75463) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Took 0.42 seconds to deallocate network for instance.
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Detaching volume: 0156e99a-d508-4db4-ae94-0a7d1fee77bd {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.compute.manager [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Detaching volume 0156e99a-d508-4db4-ae94-0a7d1fee77bd
Nov 03 17:54:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c] Skipping driver_detach during remote rebuild. {{(pid=75463) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.compute.manager [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Detaching volume cea60678-5ca6-4fc7-a612-850ab1c4ea07
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.virt.block_device [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Attempting to driver detach volume cea60678-5ca6-4fc7-a612-850ab1c4ea07 from mountpoint /dev/vdc
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Attempting to detach device vdc from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:54:25 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:54:25 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:54:25 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 17:54:25 user nova-compute[75463]:   <serial>cea60678-5ca6-4fc7-a612-850ab1c4ea07</serial>
Nov 03 17:54:25 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 17:54:25 user nova-compute[75463]: </disk>
Nov 03 17:54:25 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully detached device vdc from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the persistent domain config.
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:54:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:54:25 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:54:25 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:54:25 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 17:54:25 user nova-compute[75463]:   <serial>cea60678-5ca6-4fc7-a612-850ab1c4ea07</serial>
Nov 03 17:54:25 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 17:54:25 user nova-compute[75463]: </disk>
Nov 03 17:54:25 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:54:25 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance 64c624a1-3b7f-480d-bea1-43a9b2bc7a6c
Nov 03 17:54:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-6adb56dc-84c7-4c07-874c-9000ea30abbc tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "64c624a1-3b7f-480d-bea1-43a9b2bc7a6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.823s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:54:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:46 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 is timed out.
Nov 03 17:54:46 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully detached device vdc from instance e1b2f438-8a36-464d-b94e-c5f46f8e3704 from the live domain config.
Nov 03 17:54:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElGroazt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:54:46 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8035dc33-edd6-430d-adcc-7c77e8a7de07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:54:46 user nova-compute[75463]: No targets found.
Nov 03 17:54:46 user nova-compute[75463]: iSNS:
Nov 03 17:54:46 user nova-compute[75463]: No targets found.
Nov 03 17:54:46 user nova-compute[75463]: STATIC:
Nov 03 17:54:46 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:54:46 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:54:46 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:54:46 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07
Nov 03 17:54:46 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:54:46 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:54:46 user nova-compute[75463]: FIRMWARE:
Nov 03 17:54:46 user nova-compute[75463]: No targets found.
Nov 03 17:54:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:54:46 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:54:46 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f2ae3-324c-49b9-b197-22d260d8fd9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf57bfad-352c-45b4-9a26-399e200dd21b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:54:46 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:54:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:54:46 user nova-compute[75463]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 (non-flash)
Nov 03 17:54:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c5bb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab24e3e-7db8-4010-9e66-9053c8b4afe4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dab9b1-1ba5-4598-a3f5-6fe622915a19]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46821495-d2c1-482b-a354-083aeb5c5603]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e1a3c4-1738-427e-9e80-e0bc1eb22a3b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[09160d86-eebc-4c99-8cf3-f6592ba3a6f5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbef82e2-6d5e-4070-9eda-4708e4d9bd4d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260]
Nov 03 17:54:46 user nova-compute[75463]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07, portal: 172.16.0.220,3260] successful.
Nov 03 17:54:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea60678-5ca6-4fc7-a612-850ab1c4ea07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[203092b1-d5f4-4811-af05-c1d195423764]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] <== disconnect_volume: return (287ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:54:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:54:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'flavor' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:54:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4a57ae93-dde6-400d-972e-778234aa1ba1 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:48 user nova-compute[75463]: INFO nova.compute.manager [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Terminating instance
Nov 03 17:54:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-unplugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] No waiting events found dispatching network-vif-unplugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-951fd9e9-3a79-41fa-b11c-42e675449c50 req-d87d487b-3b1a-46e7-88cd-7f4d514265ae service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-unplugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:54:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Instance destroyed successfully.
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.objects.instance [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lazy-loading 'resources' on Instance uuid e1b2f438-8a36-464d-b94e-c5f46f8e3704 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1317632656',display_name='tempest-AttachVolumeTestJSON-server-1317632656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1317632656',id=38,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9e6ov0G/vlYVlRMbXpaVjlcyqHPkBIxYAVFjPahymEIsYFOmrPW5G17B+/hs3p694rDSlohILB/tnG4voKIsJ7H7pVtE6xVjPLhKdaK8E2mdQOUjwWWixu1PsSorRCkw==',key_name='tempest-keypair-992452773',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4f349c4a854f55a6f5c8a3b6003893',ramdisk_id='',reservation_id='r-qgb5qsjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1212926870',owner_user_name='tempest-AttachVolumeTestJSON-1212926870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:51:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45610cefcbb242f5a049f3fb3eaaa110',uuid=e1b2f438-8a36-464d-b94e-c5f46f8e3704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converting VIF {"id": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "address": "fa:16:3e:ec:0a:ff", "network": {"id": "1f88659a-5b60-4b4e-8138-23d96d2e9575", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-175416287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d4f349c4a854f55a6f5c8a3b6003893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd820a593-b5", "ovs_interfaceid": "d820a593-b5d7-48f0-80b1-b4fcb7748d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG os_vif [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd820a593-b5, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deb3fa3e-fc9a-4580-a4b1-c058747185f4) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:54:49 user nova-compute[75463]: INFO os_vif [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:0a:ff,bridge_name='br-int',has_traffic_filtering=True,id=d820a593-b5d7-48f0-80b1-b4fcb7748d43,network=Network(1f88659a-5b60-4b4e-8138-23d96d2e9575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd820a593-b5')
Nov 03 17:54:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Deleting instance files /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704_del
Nov 03 17:54:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Deletion of /opt/stack/data/nova/instances/e1b2f438-8a36-464d-b94e-c5f46f8e3704_del complete
Nov 03 17:54:49 user nova-compute[75463]: INFO nova.compute.manager [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 17:54:49 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:54:49 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:54:50 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Took 0.75 seconds to deallocate network for instance.
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:50 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Deleted allocations for instance e1b2f438-8a36-464d-b94e-c5f46f8e3704
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b86c8076-1fba-453d-91fe-9fc015de2362 tempest-AttachVolumeTestJSON-1212926870 tempest-AttachVolumeTestJSON-1212926870-project-member] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] Acquiring lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] Lock "e1b2f438-8a36-464d-b94e-c5f46f8e3704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] No waiting events found dispatching network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:54:50 user nova-compute[75463]: WARNING nova.compute.manager [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received unexpected event network-vif-plugged-d820a593-b5d7-48f0-80b1-b4fcb7748d43 for instance with vm_state deleted and task_state None.
Nov 03 17:54:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-8cb98f57-9c74-46bb-849d-75bef18b08bb req-a14e854d-d34c-430e-ae82-c6bb675f5b42 service nova] [instance: e1b2f438-8a36-464d-b94e-c5f46f8e3704] Received event network-vif-deleted-d820a593-b5d7-48f0-80b1-b4fcb7748d43 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:54:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:54 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:57 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:54:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:05 user nova-compute[75463]: INFO nova.compute.manager [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Terminating instance
Nov 03 17:55:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-unplugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] No waiting events found dispatching network-vif-unplugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-2ce6671a-258f-4dd3-aaf9-f43194ba61c3 req-c69a5039-a51d-47b7-9a79-7c394cafdf69 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-unplugged-581a79f9-3b85-4876-8364-e669d96b1245 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Instance destroyed successfully.
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.objects.instance [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lazy-loading 'resources' on Instance uuid 8a6452e2-e9e0-4dff-be0a-3df4450d230e {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1177760014',display_name='tempest-VolumesActionsTest-instance-1177760014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1177760014',id=40,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe62e0bcc91646989f6433e3692f0dfe',ramdisk_id='',reservation_id='r-os23impl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-136348732',owner_user_name='tempest-VolumesActionsTest-136348732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:53:21Z,user_data=None,user_id='8898fdead75544f38f127638944e9610',uuid=8a6452e2-e9e0-4dff-be0a-3df4450d230e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converting VIF {"id": "581a79f9-3b85-4876-8364-e669d96b1245", "address": "fa:16:3e:54:60:77", "network": {"id": "b23bcd40-8c50-46ee-9d03-63665f1623c0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1007772513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe62e0bcc91646989f6433e3692f0dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap581a79f9-3b", "ovs_interfaceid": "581a79f9-3b85-4876-8364-e669d96b1245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG os_vif [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap581a79f9-3b, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b990d87-e41b-4301-a3ae-6994d3b867c9) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:06 user nova-compute[75463]: INFO os_vif [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:60:77,bridge_name='br-int',has_traffic_filtering=True,id=581a79f9-3b85-4876-8364-e669d96b1245,network=Network(b23bcd40-8c50-46ee-9d03-63665f1623c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap581a79f9-3b')
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Deleting instance files /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e_del
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Deletion of /opt/stack/data/nova/instances/8a6452e2-e9e0-4dff-be0a-3df4450d230e_del complete
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.compute.manager [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Took 0.50 seconds to deallocate network for instance.
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b17e709-233c-4a34-a1b2-5dce6a525d45 req-f8d810f3-8dde-4134-865d-c9aeb816e183 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-deleted-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:06 user nova-compute[75463]: INFO nova.compute.manager [req-2b17e709-233c-4a34-a1b2-5dce6a525d45 req-f8d810f3-8dde-4134-865d-c9aeb816e183 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Neutron deleted interface 581a79f9-3b85-4876-8364-e669d96b1245; detaching it from the instance and deleting it from the info cache
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.network.neutron [req-2b17e709-233c-4a34-a1b2-5dce6a525d45 req-f8d810f3-8dde-4134-865d-c9aeb816e183 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b17e709-233c-4a34-a1b2-5dce6a525d45 req-f8d810f3-8dde-4134-865d-c9aeb816e183 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Detach interface failed, port_id=581a79f9-3b85-4876-8364-e669d96b1245, reason: Instance 8a6452e2-e9e0-4dff-be0a-3df4450d230e could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:06 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:55:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:55:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:07 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Deleted allocations for instance 8a6452e2-e9e0-4dff-be0a-3df4450d230e
Nov 03 17:55:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2a137c0a-ccea-4654-8f62-7a506c83f27c tempest-VolumesActionsTest-136348732 tempest-VolumesActionsTest-136348732-project-member] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.584s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] Acquiring lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] Lock "8a6452e2-e9e0-4dff-be0a-3df4450d230e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] No waiting events found dispatching network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:55:08 user nova-compute[75463]: WARNING nova.compute.manager [req-8071c836-f7c6-4733-ab7b-8db700980107 req-8bca1ef7-5d75-4d8b-9779-fad8faffb733 service nova] [instance: 8a6452e2-e9e0-4dff-be0a-3df4450d230e] Received unexpected event network-vif-plugged-581a79f9-3b85-4876-8364-e669d96b1245 for instance with vm_state deleted and task_state None.
Nov 03 17:55:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:55:09 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:55:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:55:10 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:55:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:12 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:55:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.176937103271484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance a0629ec4-70de-4fd6-b779-541d1212b19d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 17:55:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 17:55:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 17:55:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing instance network info cache due to event network-changed-da62c138-2fe9-4912-aa44-d8d717c0c039. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] Acquiring lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] Acquired lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.network.neutron [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Refreshing network info cache for port da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:24 user nova-compute[75463]: INFO nova.compute.manager [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Terminating instance
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-unplugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] No waiting events found dispatching network-vif-unplugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.compute.manager [req-1bc6ffed-82d2-4997-be79-1031f57f1c13 req-3f354bb9-c370-4830-a956-9a033408e360 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-unplugged-da62c138-2fe9-4912-aa44-d8d717c0c039 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.network.neutron [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updated VIF entry in instance network info cache for port da62c138-2fe9-4912-aa44-d8d717c0c039. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.network.neutron [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating instance_info_cache with network_info: [{"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f32ee71e-e155-4fd7-a038-378e0a0ec30c req-3bec9120-f597-45fc-b359-79f96aa6fdb2 service nova] Releasing lock "refresh_cache-a0629ec4-70de-4fd6-b779-541d1212b19d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:55:24 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Instance destroyed successfully.
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lazy-loading 'resources' on Instance uuid a0629ec4-70de-4fd6-b779-541d1212b19d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-595186901',display_name='tempest-TestVolumeBootPattern-server-595186901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-595186901',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG+UD9kaVZN1jm1lcsdG4E9ZBSQyjiMyjtkO3cuLlz8vp/sUeDkYrdaVxSOMEsno5Y6QGc8yhJgqAseYOeKWmJf9YEkEZ+1ZQr6xqN+tG4YF1aXnz8u6XKTxFd5crOp9w==',key_name='tempest-TestVolumeBootPattern-1614840203',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88d74abcd4a349ab96ba0f188542d61c',ramdisk_id='',reservation_id='r-qsytqp01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-79691840',owner_user_name='tempest-TestVolumeBootPattern-79691840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:52:27Z,user_data=None,user_id='85b5595e7da047d9965cd795b2e6a83b',uuid=a0629ec4-70de-4fd6-b779-541d1212b19d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converting VIF {"id": "da62c138-2fe9-4912-aa44-d8d717c0c039", "address": "fa:16:3e:89:f9:9c", "network": {"id": "4a641624-3854-4405-97cc-179d3e482237", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1571098743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88d74abcd4a349ab96ba0f188542d61c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda62c138-2f", "ovs_interfaceid": "da62c138-2fe9-4912-aa44-d8d717c0c039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_vif [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda62c138-2f, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=708987f5-1069-4126-9443-85c1caf271c8) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:24 user nova-compute[75463]: INFO os_vif [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:f9:9c,bridge_name='br-int',has_traffic_filtering=True,id=da62c138-2fe9-4912-aa44-d8d717c0c039,network=Network(4a641624-3854-4405-97cc-179d3e482237),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda62c138-2f')
Nov 03 17:55:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iDVKXIAZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:55:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ba914-23de-47fa-ae04-4dfa2f715da4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:55:24 user nova-compute[75463]: No targets found.
Nov 03 17:55:24 user nova-compute[75463]: iSNS:
Nov 03 17:55:24 user nova-compute[75463]: No targets found.
Nov 03 17:55:24 user nova-compute[75463]: STATIC:
Nov 03 17:55:24 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65
Nov 03 17:55:24 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:55:24 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:55:24 user nova-compute[75463]: FIRMWARE:
Nov 03 17:55:24 user nova-compute[75463]: No targets found.
Nov 03 17:55:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:55:24 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:55:24 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbef54e-c1ac-4728-947d-397d140dc840]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b321ffbd-5a08-404d-a00c-6f8a4467a410]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:55:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 (non-flash)
Nov 03 17:55:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec4212d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c119030-f4f2-4382-bd35-1cff5e10bd29]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb15aa-356a-42bb-99ab-5219ee4e9052]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0f4da-3c76-430d-913b-d8ef378a903c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5df548-4055-41dc-b04f-9475d17f3f7b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d143a-4190-418c-b696-c1c902ff1557]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb26d1-d472-4708-a719-5b684b1e6615]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260]
Nov 03 17:55:25 user nova-compute[75463]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65, portal: 172.16.0.220,3260] successful.
Nov 03 17:55:25 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379d4ecb-1513-4250-8d3e-e7cf5bf4ad65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc285b-523b-4a51-b595-c7d2ae91c3d5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] <== disconnect_volume: return (298ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:55:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Deleting instance files /opt/stack/data/nova/instances/a0629ec4-70de-4fd6-b779-541d1212b19d_del
Nov 03 17:55:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Deletion of /opt/stack/data/nova/instances/a0629ec4-70de-4fd6-b779-541d1212b19d_del complete
Nov 03 17:55:25 user nova-compute[75463]: INFO nova.compute.manager [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 03 17:55:25 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:55:25 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:25 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Took 0.42 seconds to deallocate network for instance.
Nov 03 17:55:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] Acquiring lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] No waiting events found dispatching network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:55:26 user nova-compute[75463]: WARNING nova.compute.manager [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received unexpected event network-vif-plugged-da62c138-2fe9-4912-aa44-d8d717c0c039 for instance with vm_state active and task_state deleting.
Nov 03 17:55:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-f88c9427-f9c7-44aa-b394-c6c15bdb6e80 req-43f2b1dc-81f6-4736-a29a-cfca4a6db6fe service nova] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Received event network-vif-deleted-da62c138-2fe9-4912-aa44-d8d717c0c039 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:26 user nova-compute[75463]: INFO nova.compute.manager [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] [instance: a0629ec4-70de-4fd6-b779-541d1212b19d] Took 0.87 seconds to detach 1 volumes for instance.
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:26 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Deleted allocations for instance a0629ec4-70de-4fd6-b779-541d1212b19d
Nov 03 17:55:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-714ab76f-9d78-4234-b29f-c6e3dd50f9fb tempest-TestVolumeBootPattern-79691840 tempest-TestVolumeBootPattern-79691840-project-member] Lock "a0629ec4-70de-4fd6-b779-541d1212b19d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:55:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:55:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-changed-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Refreshing instance network info cache due to event network-changed-b3455bf3-4151-408b-8ac7-d25207918c93. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:55:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] Acquiring lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:55:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] Acquired lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:55:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Refreshing network info cache for port b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:55:46 user nova-compute[75463]: DEBUG nova.network.neutron [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updated VIF entry in instance network info cache for port b3455bf3-4151-408b-8ac7-d25207918c93. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:55:46 user nova-compute[75463]: DEBUG nova.network.neutron [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating instance_info_cache with network_info: [{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1c00ba88-c37b-4ce7-bfa5-aa71c5c35ea1 req-90833404-c1db-4395-8fd1-3eca0b09b9bb service nova] Releasing lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:55:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:51 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lazy-loading 'flavor' on Instance uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:52 user nova-compute[75463]: INFO nova.compute.manager [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Attaching volume 25e297b9-d779-47af-a227-641271e1c69d to /dev/vdb
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.utils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[72185fb6-9913-48a6-845f-b839aa3ed9fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9dbbd-273f-4d22-8235-f99692286257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a41868f-adaf-42f6-bf0b-857aa3a7c7eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec03ff4-ef96-4aec-89a8-0c23d5f2e522]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:55:52 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e277c-2311-4948-8cd5-195e616a4f7c]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG os_brick.utils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating existing volume attachment record: fc7c13fe-b8f1-4ee1-b0d5-018ad023d508 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing instance network info cache due to event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG nova.network.neutron [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:55:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG nova.objects.instance [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updated VIF entry in instance network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG nova.network.neutron [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b8f663ef-15d9-4801-bf00-d0108e1d5e91 req-6be35f10-58f3-4b74-889f-e2c6cae21a98 service nova] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:55:53 user nova-compute[75463]: INFO nova.compute.manager [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Attaching volume e4190e05-4cef-4e10-a217-f6140220bb36 to /dev/vdb
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[16872112-5e4c-4f61-bb88-27e0246f6bb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[716d5c1b-7f2d-4c5c-82cb-861a2eaf1b32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5d923-c1c8-43d0-84c2-eabfa951cb26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f8edf-b5c9-4275-99ad-9f43bd253c14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:55:53 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:55:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b78c47-2738-459c-88e5-1b90dc0aae48]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:55:53 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating existing volume attachment record: 5e63da5f-9fc1-4260-8c59-c72d0d84423b {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:55:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:55:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:55:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:56:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:56:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:56:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:56:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:56:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:56:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKYgVzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:56:13 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:13 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:13 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13d1b1-7690-4563-b0fd-7d27a8cb9602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:56:13 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b08c48c-93c1-4ba5-95a7-4eabecbfc889]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d] added
Nov 03 17:56:13 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f87333-845a-4de7-a9da-1d4d7207e952]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9361d0-1e35-47ba-aab8-9d2930b004a1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUKYgVzr {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUKYgVzr" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7455fa1-83f5-4a38-a5fc-c23503797d0a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUKYgVzr'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4a785b-13dd-4db7-914d-c65878f20f23]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3af76b-3b53-485e-808e-46593db7d7f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:56:14 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:56:14 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:14 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:56:14 user nova-compute[75463]: 
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af80dd-9ed6-4cd4-9035-6fc231018894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260]
Nov 03 17:56:14 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260] successful.
Nov 03 17:56:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d900ab-0f5f-4269-8243-ba4db6ee519e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d47fbd-8311-4876-a64a-ace9fcfcbb63]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[354124c8-304e-48f6-a0d3-24eb7b0d9ab3]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKYgVzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23936383864373238', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936383864373238', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lazy-loading 'flavor' on Instance uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:56:15 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:15 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:56:15 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:15 user nova-compute[75463]:   <serial>25e297b9-d779-47af-a227-641271e1c69d</serial>
Nov 03 17:56:15 user nova-compute[75463]: </disk>
Nov 03 17:56:15 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdAsITmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:56:15 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:15 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:15 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aae6a5-7e3d-43f3-a501-fd7729200969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:56:15 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b670f3-bbff-4f86-9806-0d304b684661]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36] added
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9236d592-035c-45cf-84ad-7a8f5cdd10d2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[738363ab-8fe7-4a8e-9236-eb3e2e5d46ab]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdAsITmV {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdAsITmV" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c13349-f556-4353-a84f-49c724aefe53]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PdAsITmV'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9296176e-1ad1-4cc7-84c8-c92185553316]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437334a-d54e-4891-96f9-7b21283f778e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[36979cdd-6ab4-4b3e-9079-6fb5ddae1014]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260]
Nov 03 17:56:15 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260] successful.
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7a07f-d29b-424f-a466-ba14daf0e634]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fde4f4-959d-4de0-8daa-7c91ffc166a3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:15 user nova-compute[75463]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:15 user nova-compute[75463]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] No VIF found with MAC fa:16:3e:be:65:df, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b8fe6-2750-45d0-af28-f206b11dd15e]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdAsITmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3a8e9be8-5fcb-49c4-b51c-9ddbd78aee3f tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.847s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:16 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:56:16 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=25.166519165039062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23831346362663963', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831346362663963', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.objects.instance [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:56:16 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:16 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:56:16 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:16 user nova-compute[75463]:   <serial>e4190e05-4cef-4e10-a217-f6140220bb36</serial>
Nov 03 17:56:16 user nova-compute[75463]: </disk>
Nov 03 17:56:16 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:56:16 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:17 user nova-compute[75463]: WARNING nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No VIF found with MAC fa:16:3e:db:bb:b3, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-68b10d2b-b96e-4c42-a186-f3349ba89ffe tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.122s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.245s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:18 user nova-compute[75463]: INFO nova.compute.manager [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Detaching volume 25e297b9-d779-47af-a227-641271e1c69d
Nov 03 17:56:18 user nova-compute[75463]: INFO nova.virt.block_device [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Attempting to driver detach volume 25e297b9-d779-47af-a227-641271e1c69d from mountpoint /dev/vdb
Nov 03 17:56:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Attempting to detach device vdb from instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:56:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:56:18 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:18 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:56:18 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:18 user nova-compute[75463]:   <serial>25e297b9-d779-47af-a227-641271e1c69d</serial>
Nov 03 17:56:18 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:56:18 user nova-compute[75463]: </disk>
Nov 03 17:56:18 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:56:18 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Successfully detached device vdb from instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 from the persistent domain config.
Nov 03 17:56:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:56:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:56:18 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:18 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 17:56:18 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:18 user nova-compute[75463]:   <serial>25e297b9-d779-47af-a227-641271e1c69d</serial>
Nov 03 17:56:18 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:56:18 user nova-compute[75463]: </disk>
Nov 03 17:56:18 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:56:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:56:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:56:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:56:20 user nova-compute[75463]: INFO nova.compute.manager [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Detaching volume e4190e05-4cef-4e10-a217-f6140220bb36
Nov 03 17:56:20 user nova-compute[75463]: INFO nova.virt.block_device [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Attempting to driver detach volume e4190e05-4cef-4e10-a217-f6140220bb36 from mountpoint /dev/vdb
Nov 03 17:56:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Attempting to detach device vdb from instance 2bf1471d-815e-4db6-bd76-39f19d901359 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:56:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:56:20 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:20 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:56:20 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:20 user nova-compute[75463]:   <serial>e4190e05-4cef-4e10-a217-f6140220bb36</serial>
Nov 03 17:56:20 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:56:20 user nova-compute[75463]: </disk>
Nov 03 17:56:20 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:56:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully detached device vdb from instance 2bf1471d-815e-4db6-bd76-39f19d901359 from the persistent domain config.
Nov 03 17:56:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bf1471d-815e-4db6-bd76-39f19d901359 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:56:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:56:20 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:56:20 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:56:20 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:56:20 user nova-compute[75463]:   <serial>e4190e05-4cef-4e10-a217-f6140220bb36</serial>
Nov 03 17:56:20 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:56:20 user nova-compute[75463]: </disk>
Nov 03 17:56:20 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:56:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:56:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:29 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:39 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 is timed out.
Nov 03 17:56:39 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Successfully detached device vdb from instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 from the live domain config.
Nov 03 17:56:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKYgVzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:56:39 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf5e8d8-d08b-442b-8cc3-b54c2b9a867f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:56:39 user nova-compute[75463]: No targets found.
Nov 03 17:56:39 user nova-compute[75463]: iSNS:
Nov 03 17:56:39 user nova-compute[75463]: No targets found.
Nov 03 17:56:39 user nova-compute[75463]: STATIC:
Nov 03 17:56:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e
Nov 03 17:56:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:56:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:56:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36
Nov 03 17:56:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:56:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:56:39 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d
Nov 03 17:56:39 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:56:39 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:56:39 user nova-compute[75463]: FIRMWARE:
Nov 03 17:56:39 user nova-compute[75463]: No targets found.
Nov 03 17:56:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:56:39 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:56:39 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[12442cd6-f97f-4f21-9df6-09d689f802b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7957cb-a506-45eb-9593-e9dd470883d5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:39 user nova-compute[75463]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:39 user nova-compute[75463]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e (non-flash)
Nov 03 17:56:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d (non-flash)
Nov 03 17:56:39 user nova-compute[75463]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:39 user nova-compute[75463]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dcaf2bc-c2d3-45ee-8582-93499e9c4d8e (non-flash)
Nov 03 17:56:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec4209d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[538e9f16-bab7-4157-b61f-c70932b208d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b2d5f-2100-43f5-85ff-0e76630b7f7b]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8405a-e92c-4e02-b091-aecb8e6b6d09]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa74e1-9cc3-4f08-a2ec-1582e92a3101]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a28c0-446b-4d83-b1a9-61ab8bcdc0ea]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b01d30-f176-4cd0-b2fc-b993e35ea046]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260]
Nov 03 17:56:39 user nova-compute[75463]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d, portal: 172.16.0.220,3260] successful.
Nov 03 17:56:39 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e297b9-d779-47af-a227-641271e1c69d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fbc74e-dd49-444c-847b-3eadd8fa5e40]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] <== disconnect_volume: return (346ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:56:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:40 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lazy-loading 'flavor' on Instance uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:56:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0ae7fbf4-2932-4ef2-af5d-119052281141 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.161s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bf1471d-815e-4db6-bd76-39f19d901359 is timed out.
Nov 03 17:56:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully detached device vdb from instance 2bf1471d-815e-4db6-bd76-39f19d901359 from the live domain config.
Nov 03 17:56:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdAsITmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:56:41 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed068e8b-6935-47d4-b9da-46db13fd93a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 17:56:41 user nova-compute[75463]: No targets found.
Nov 03 17:56:41 user nova-compute[75463]: iSNS:
Nov 03 17:56:41 user nova-compute[75463]: No targets found.
Nov 03 17:56:41 user nova-compute[75463]: STATIC:
Nov 03 17:56:41 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36
Nov 03 17:56:41 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 17:56:41 user nova-compute[75463]:                 Iface Name: default
Nov 03 17:56:41 user nova-compute[75463]: FIRMWARE:
Nov 03 17:56:41 user nova-compute[75463]: No targets found.
Nov 03 17:56:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 17:56:41 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 17:56:41 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b02972-32e6-4241-b809-2013fd9b8b63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a259cc-6298-4acc-8194-eb0b335aad25]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 (non-flash)
Nov 03 17:56:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec492d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c752e5f7-806c-4831-a67c-d25d30a9e9b0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732a09d-1681-4188-a710-7f868cc3c479]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b9a9e4-867f-41e7-a24a-c0d714cd493d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e7fa8-4af5-4dd2-8ba9-7e8e88f6db08]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda908d-594b-4fbb-a454-3fc8cc955949]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf948955-5f33-45b0-a9ff-5d7810a827a1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260]
Nov 03 17:56:41 user nova-compute[75463]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36, portal: 172.16.0.220,3260] successful.
Nov 03 17:56:41 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4190e05-4cef-4e10-a217-f6140220bb36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4fb67-09c0-42ee-8adb-43f2fb72d8dd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== disconnect_volume: return (283ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:56:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 17:56:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:56:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-c2d215f3-801d-459a-9419-f7f82f61cad8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:56:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:56:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:56:55 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:56:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:04 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:05 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:57:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:13 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating instance_info_cache with network_info: [{"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-17378cbe-33d0-4aa4-a2fc-0cd6619e1054" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:57:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:57:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:57:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:57:15 user nova-compute[75463]: INFO nova.compute.claims [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Claim successful on node user
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:57:15 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.policy [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faa80d6b17442a78b609734e886ab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b6da9208ff44ef8b898e4f0023724a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:57:15 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Creating image(s)
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Successfully created port: 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.537s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG nova.virt.images [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] 0a446b3c-f9dc-4a6f-97b2-babde504b2c2 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.part /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.part /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.converted" returned: 0 in 0.247s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.167s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Successfully updated port: 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:57:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing instance network info cache due to event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44,backing_fmt=raw /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44,backing_fmt=raw /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk 1073741824" returned: 0 in 0.047s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "33b70335dbe96f7a4d59f21c09679c3fd4e81b44" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance network_info: |[{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json" returned: 0 in 0.447s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.network.neutron [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:17 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:17 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.133014678955078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Cannot resize image /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Ensure instance console log exists: /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start _get_guest_xml network_info=[{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:57:11Z,direct_url=<?>,disk_format='qcow2',id=0a446b3c-f9dc-4a6f-97b2-babde504b2c2,min_disk=0,min_ram=0,name='tempest-scenario-img--178669434',owner='68b6da9208ff44ef8b898e4f0023724a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:57:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0a446b3c-f9dc-4a6f-97b2-babde504b2c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:57:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:57:11Z,direct_url=<?>,disk_format='qcow2',id=0a446b3c-f9dc-4a6f-97b2-babde504b2c2,min_disk=0,min_ram=0,name='tempest-scenario-img--178669434',owner='68b6da9208ff44ef8b898e4f0023724a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:57:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:57:16Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.objects.instance [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'pci_devices' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:57:18 user nova-compute[75463]:   <uuid>169b34f8-40ca-4bad-ba3f-bcef4a67898d</uuid>
Nov 03 17:57:18 user nova-compute[75463]:   <name>instance-0000002c</name>
Nov 03 17:57:18 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:57:18 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:57:18 user nova-compute[75463]:   <metadata>
Nov 03 17:57:18 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:57:18 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:name>tempest-TestMinimumBasicScenario-server-160404226</nova:name>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:57:18</nova:creationTime>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:57:18 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:57:18 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:owner>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:user uuid="5faa80d6b17442a78b609734e886ab13">tempest-TestMinimumBasicScenario-988383719-project-member</nova:user>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:project uuid="68b6da9208ff44ef8b898e4f0023724a">tempest-TestMinimumBasicScenario-988383719</nova:project>
Nov 03 17:57:18 user nova-compute[75463]:       </nova:owner>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:root type="image" uuid="0a446b3c-f9dc-4a6f-97b2-babde504b2c2"/>
Nov 03 17:57:18 user nova-compute[75463]:       <nova:ports>
Nov 03 17:57:18 user nova-compute[75463]:         <nova:port uuid="0912b743-5213-473e-b72c-da1fccc45c7d">
Nov 03 17:57:18 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 17:57:18 user nova-compute[75463]:         </nova:port>
Nov 03 17:57:18 user nova-compute[75463]:       </nova:ports>
Nov 03 17:57:18 user nova-compute[75463]:     </nova:instance>
Nov 03 17:57:18 user nova-compute[75463]:   </metadata>
Nov 03 17:57:18 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:57:18 user nova-compute[75463]:     <system>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="serial">169b34f8-40ca-4bad-ba3f-bcef4a67898d</entry>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="uuid">169b34f8-40ca-4bad-ba3f-bcef4a67898d</entry>
Nov 03 17:57:18 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:57:18 user nova-compute[75463]:     </system>
Nov 03 17:57:18 user nova-compute[75463]:   </sysinfo>
Nov 03 17:57:18 user nova-compute[75463]:   <os>
Nov 03 17:57:18 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:57:18 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:57:18 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:57:18 user nova-compute[75463]:   </os>
Nov 03 17:57:18 user nova-compute[75463]:   <features>
Nov 03 17:57:18 user nova-compute[75463]:     <acpi/>
Nov 03 17:57:18 user nova-compute[75463]:     <apic/>
Nov 03 17:57:18 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:57:18 user nova-compute[75463]:   </features>
Nov 03 17:57:18 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:57:18 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:57:18 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:57:18 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:57:18 user nova-compute[75463]:   </clock>
Nov 03 17:57:18 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:57:18 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:57:18 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:57:18 user nova-compute[75463]:   </cpu>
Nov 03 17:57:18 user nova-compute[75463]:   <devices>
Nov 03 17:57:18 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:57:18 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:57:18 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk"/>
Nov 03 17:57:18 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:57:18 user nova-compute[75463]:     </disk>
Nov 03 17:57:18 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:57:18 user nova-compute[75463]:       <mac address="fa:16:3e:23:c5:85"/>
Nov 03 17:57:18 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:57:18 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:57:18 user nova-compute[75463]:       <target dev="tap0912b743-52"/>
Nov 03 17:57:18 user nova-compute[75463]:     </interface>
Nov 03 17:57:18 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:57:18 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/console.log" append="off"/>
Nov 03 17:57:18 user nova-compute[75463]:     </serial>
Nov 03 17:57:18 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:57:18 user nova-compute[75463]:     <video>
Nov 03 17:57:18 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:57:18 user nova-compute[75463]:     </video>
Nov 03 17:57:18 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:57:18 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:57:18 user nova-compute[75463]:     </rng>
Nov 03 17:57:18 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:57:18 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:57:18 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:57:18 user nova-compute[75463]:     </memballoon>
Nov 03 17:57:18 user nova-compute[75463]:   </devices>
Nov 03 17:57:18 user nova-compute[75463]: </domain>
Nov 03 17:57:18 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:57:16Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG os_vif [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '135f60c7-bc7b-5ab2-a010-7250076347a7', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0912b743-52, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0912b743-52, col_values=(('qos', UUID('89398861-ee02-4624-bbd4-b3b8906d0081')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0912b743-52, col_values=(('external_ids', {'iface-id': '0912b743-5213-473e-b72c-da1fccc45c7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:c5:85', 'vm-uuid': '169b34f8-40ca-4bad-ba3f-bcef4a67898d'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:18 user nova-compute[75463]: INFO os_vif [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52')
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No VIF found with MAC fa:16:3e:23:c5:85, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated VIF entry in instance network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG nova.network.neutron [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7027e2d9-beaa-4846-a705-819d25d7836b req-c0c669d9-1289-42b7-ad15-fd27bb77999f service nova] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:19 user nova-compute[75463]: WARNING nova.compute.manager [req-8bf7b11f-9aea-4d16-8bfb-a8a75d939b98 req-dbd16969-35ea-4cc9-bd1d-d0b9718928d2 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state building and task_state spawning.
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:20 user nova-compute[75463]: INFO nova.compute.manager [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Terminating instance
Nov 03 17:57:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 17:57:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Instance destroyed successfully.
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.objects.instance [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lazy-loading 'resources' on Instance uuid 17378cbe-33d0-4aa4-a2fc-0cd6619e1054 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-889895382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8898953',id=41,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNejgbIeEt8mP0PXk7vfHA3YckHxDvG+MejbHsQP1xI6t3omMiWxiS68FEukWlCj1Im3ya76YSVFt0Beoq+zo06kR7eK+MB1h+tZtHR+fV7Qtas1Mt5DA7a+4JQXkFcFOA==',key_name='tempest-keypair-1977038688',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='058766f9c1614db6b3a88c8dbafa1f0c',ramdisk_id='',reservation_id='r-5qykkifq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b68f632f47403cbd0bc07a1bc6f262',uuid=17378cbe-33d0-4aa4-a2fc-0cd6619e1054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converting VIF {"id": "b3455bf3-4151-408b-8ac7-d25207918c93", "address": "fa:16:3e:be:65:df", "network": {"id": "b171818c-5d9b-4c02-a93d-2c911e1586c3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-131086302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "058766f9c1614db6b3a88c8dbafa1f0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3455bf3-41", "ovs_interfaceid": "b3455bf3-4151-408b-8ac7-d25207918c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG os_vif [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3455bf3-41, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea0aa28e-2b17-47e0-a190-c9fcf44a558b) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:57:21 user nova-compute[75463]: INFO os_vif [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:65:df,bridge_name='br-int',has_traffic_filtering=True,id=b3455bf3-4151-408b-8ac7-d25207918c93,network=Network(b171818c-5d9b-4c02-a93d-2c911e1586c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3455bf3-41')
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Deleting instance files /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054_del
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Deletion of /opt/stack/data/nova/instances/17378cbe-33d0-4aa4-a2fc-0cd6619e1054_del complete
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.compute.manager [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance spawned successfully.
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:21 user nova-compute[75463]: WARNING nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state building and task_state spawning.
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-unplugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] No waiting events found dispatching network-vif-unplugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-unplugged-b3455bf3-4151-408b-8ac7-d25207918c93 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Acquiring lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] No waiting events found dispatching network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:21 user nova-compute[75463]: WARNING nova.compute.manager [req-67e98533-c647-4057-8117-fbd0b7f004af req-0f144f53-3bb8-4a64-bdcb-cafa3384cae4 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received unexpected event network-vif-plugged-b3455bf3-4151-408b-8ac7-d25207918c93 for instance with vm_state active and task_state deleting.
Nov 03 17:57:21 user nova-compute[75463]: INFO nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 03 17:57:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:57:22 user nova-compute[75463]: INFO nova.compute.manager [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Took 6.97 seconds to build instance.
Nov 03 17:57:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-99f9ca62-bf84-4bae-a032-b6030796ca7c tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:22 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Took 0.86 seconds to deallocate network for instance.
Nov 03 17:57:22 user nova-compute[75463]: DEBUG nova.compute.manager [req-5108e5d0-18a1-4609-ab8b-ec3ce2ff3500 req-47f64826-9c1e-4d46-83b6-2d3b63eba712 service nova] [instance: 17378cbe-33d0-4aa4-a2fc-0cd6619e1054] Received event network-vif-deleted-b3455bf3-4151-408b-8ac7-d25207918c93 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:23 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Deleted allocations for instance 17378cbe-33d0-4aa4-a2fc-0cd6619e1054
Nov 03 17:57:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-81150a60-01bb-48df-a57b-c970af26050b tempest-TestServerVolumeAttachScenarioOldVersion-1715016178 tempest-TestServerVolumeAttachScenarioOldVersion-1715016178-project-member] Lock "17378cbe-33d0-4aa4-a2fc-0cd6619e1054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:57:23 user nova-compute[75463]: INFO nova.compute.manager [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] instance snapshotting
Nov 03 17:57:23 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Beginning live snapshot process
Nov 03 17:57:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json -f qcow2 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8.delta 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8.delta 1073741824" returned: 0 in 0.050s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:24 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 03 17:57:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:57:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75463) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 03 17:57:25 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 03 17:57:25 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:57:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8.delta /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8.delta /opt/stack/data/nova/instances/snapshots/tmpxmgsh2_3/38b9e839b74e400fa5e877608eb231e8" returned: 0 in 0.432s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Snapshot extracted, beginning image upload
Nov 03 17:57:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Snapshot image upload complete
Nov 03 17:57:28 user nova-compute[75463]: INFO nova.compute.manager [None req-c241c79a-9956-45e7-8707-d51ca65e5a75 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 03 17:57:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:57:31 user nova-compute[75463]: INFO nova.compute.claims [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Claim successful on node user
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:57:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.policy [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3917b2874c454ef39166a58e155bba9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e79281ae1b44bdbd88ca10c3cc2c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:57:32 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Creating image(s)
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "/opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "/opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "/opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Successfully created port: dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG nova.virt.images [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] 22231282-c07b-4b43-b122-631c076ded43 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.part /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.part /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.converted" returned: 0 in 0.647s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.854s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Successfully updated port: dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquired lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing instance network info cache due to event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] Acquiring lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json" returned: 0 in 0.221s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json" returned: 0 in 0.202s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27,backing_fmt=raw /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27,backing_fmt=raw /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk 1073741824" returned: 0 in 0.057s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "ad3e3762623d1133be4e5cf92da1e0fde63f7a27" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating instance_info_cache with network_info: [{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Releasing lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Instance network_info: |[{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] Acquired lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 --force-share --output=json" returned: 0 in 0.217s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Ensure instance console log exists: /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Start _get_guest_xml network_info=[{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='79ccffafcb555cf110dba379fe677336',container_format='bare',created_at=2023-11-03T17:57:23Z,direct_url=<?>,disk_format='qcow2',id=22231282-c07b-4b43-b122-631c076ded43,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-169185604',owner='45e79281ae1b44bdbd88ca10c3cc2c89',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:57:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '22231282-c07b-4b43-b122-631c076ded43'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:57:34 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:34 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='79ccffafcb555cf110dba379fe677336',container_format='bare',created_at=2023-11-03T17:57:23Z,direct_url=<?>,disk_format='qcow2',id=22231282-c07b-4b43-b122-631c076ded43,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-169185604',owner='45e79281ae1b44bdbd88ca10c3cc2c89',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-03T17:57:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008012237',display_name='tempest-TestStampPattern-server-1008012237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1008012237',id=45,image_ref='22231282-c07b-4b43-b122-631c076ded43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-u3l044s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2bf1471d-815e-4db6-bd76-39f19d901359',image_min_disk='1',image_min_ram='0',image_owner_id='45e79281ae1b44bdbd88ca10c3cc2c89',image_owner_project_name='tempest-TestStampPattern-1270453444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1270453444-project-member',image_user_id='3917b2874c454ef39166a58e155bba9d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:57:32Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'pci_devices' on Instance uuid 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:57:34 user nova-compute[75463]:   <uuid>44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56</uuid>
Nov 03 17:57:34 user nova-compute[75463]:   <name>instance-0000002d</name>
Nov 03 17:57:34 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:57:34 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:57:34 user nova-compute[75463]:   <metadata>
Nov 03 17:57:34 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:57:34 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:name>tempest-TestStampPattern-server-1008012237</nova:name>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:57:34</nova:creationTime>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:57:34 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:57:34 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:owner>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:user uuid="3917b2874c454ef39166a58e155bba9d">tempest-TestStampPattern-1270453444-project-member</nova:user>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:project uuid="45e79281ae1b44bdbd88ca10c3cc2c89">tempest-TestStampPattern-1270453444</nova:project>
Nov 03 17:57:34 user nova-compute[75463]:       </nova:owner>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:root type="image" uuid="22231282-c07b-4b43-b122-631c076ded43"/>
Nov 03 17:57:34 user nova-compute[75463]:       <nova:ports>
Nov 03 17:57:34 user nova-compute[75463]:         <nova:port uuid="dddeac46-976e-487f-9ee4-fd4f69d5a441">
Nov 03 17:57:34 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 17:57:34 user nova-compute[75463]:         </nova:port>
Nov 03 17:57:34 user nova-compute[75463]:       </nova:ports>
Nov 03 17:57:34 user nova-compute[75463]:     </nova:instance>
Nov 03 17:57:34 user nova-compute[75463]:   </metadata>
Nov 03 17:57:34 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:57:34 user nova-compute[75463]:     <system>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="serial">44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56</entry>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="uuid">44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56</entry>
Nov 03 17:57:34 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:57:34 user nova-compute[75463]:     </system>
Nov 03 17:57:34 user nova-compute[75463]:   </sysinfo>
Nov 03 17:57:34 user nova-compute[75463]:   <os>
Nov 03 17:57:34 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:57:34 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:57:34 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:57:34 user nova-compute[75463]:   </os>
Nov 03 17:57:34 user nova-compute[75463]:   <features>
Nov 03 17:57:34 user nova-compute[75463]:     <acpi/>
Nov 03 17:57:34 user nova-compute[75463]:     <apic/>
Nov 03 17:57:34 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:57:34 user nova-compute[75463]:   </features>
Nov 03 17:57:34 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:57:34 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:57:34 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:57:34 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:57:34 user nova-compute[75463]:   </clock>
Nov 03 17:57:34 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:57:34 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:57:34 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:57:34 user nova-compute[75463]:   </cpu>
Nov 03 17:57:34 user nova-compute[75463]:   <devices>
Nov 03 17:57:34 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:57:34 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:57:34 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk"/>
Nov 03 17:57:34 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:57:34 user nova-compute[75463]:     </disk>
Nov 03 17:57:34 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:57:34 user nova-compute[75463]:       <mac address="fa:16:3e:38:c4:70"/>
Nov 03 17:57:34 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:57:34 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:57:34 user nova-compute[75463]:       <target dev="tapdddeac46-97"/>
Nov 03 17:57:34 user nova-compute[75463]:     </interface>
Nov 03 17:57:34 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:57:34 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/console.log" append="off"/>
Nov 03 17:57:34 user nova-compute[75463]:     </serial>
Nov 03 17:57:34 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:57:34 user nova-compute[75463]:     <video>
Nov 03 17:57:34 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:57:34 user nova-compute[75463]:     </video>
Nov 03 17:57:34 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:57:34 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:57:34 user nova-compute[75463]:     </rng>
Nov 03 17:57:34 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:57:34 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:57:34 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:57:34 user nova-compute[75463]:     </memballoon>
Nov 03 17:57:34 user nova-compute[75463]:   </devices>
Nov 03 17:57:34 user nova-compute[75463]: </domain>
Nov 03 17:57:34 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008012237',display_name='tempest-TestStampPattern-server-1008012237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1008012237',id=45,image_ref='22231282-c07b-4b43-b122-631c076ded43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-u3l044s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2bf1471d-815e-4db6-bd76-39f19d901359',image_min_disk='1',image_min_ram='0',image_owner_id='45e79281ae1b44bdbd88ca10c3cc2c89',image_owner_project_name='tempest-TestStampPattern-1270453444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1270453444-project-member',image_user_id='3917b2874c454ef39166a58e155bba9d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:57:32Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG os_vif [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f88e34ea-6a14-5799-8951-27e7e5416b33', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdddeac46-97, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdddeac46-97, col_values=(('qos', UUID('89a16ab8-08bb-42d2-82d1-c738997540ac')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdddeac46-97, col_values=(('external_ids', {'iface-id': 'dddeac46-976e-487f-9ee4-fd4f69d5a441', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:c4:70', 'vm-uuid': '44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:35 user nova-compute[75463]: INFO os_vif [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97')
Nov 03 17:57:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No VIF found with MAC fa:16:3e:38:c4:70, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updated VIF entry in instance network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG nova.network.neutron [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating instance_info_cache with network_info: [{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:57:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4a8968f0-5b95-42ef-8819-2da45acc8da0 req-4631e37c-d400-4080-b8b0-9c7f508bfbf6 service nova] Releasing lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] No waiting events found dispatching network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:36 user nova-compute[75463]: WARNING nova.compute.manager [req-2b2db6a1-5aa3-464b-8c05-5ed06f98e0bc req-e46d5a40-29c4-4cbc-be8d-80f396400bdc service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received unexpected event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 for instance with vm_state building and task_state spawning.
Nov 03 17:57:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:57:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Instance spawned successfully.
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.compute.manager [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.compute.manager [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] No waiting events found dispatching network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:57:38 user nova-compute[75463]: WARNING nova.compute.manager [req-68426d84-361c-428c-91d5-98bfd4f57a9a req-a2e12884-1772-48f4-89dc-d4b9677aed2e service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received unexpected event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 for instance with vm_state building and task_state spawning.
Nov 03 17:57:38 user nova-compute[75463]: INFO nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 03 17:57:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:57:38 user nova-compute[75463]: INFO nova.compute.manager [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Took 7.17 seconds to build instance.
Nov 03 17:57:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5fda5adb-2939-4669-8dd9-ebef8c516e85 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.276s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:57:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:57:56 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:57:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:58:09 user nova-compute[75463]: INFO nova.compute.claims [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Claim successful on node user
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:58:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:58:09 user nova-compute[75463]: DEBUG nova.policy [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1b71d43c9e84a738a81e56daf4a14d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692ebed50cd34a6abcb2ec108bd28669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:58:09 user nova-compute[75463]: INFO nova.virt.block_device [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Booting with volume ae002ae6-2260-40e2-ab44-c08b22e51e40 at /dev/vda
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.utils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb11d0c-85c7-423d-aa46-5ed727c3904f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[47836b30-bd92-457c-9764-83df17fc9adb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9038255-9953-4bdb-b90d-3aa9424cba6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb387a96-9e4a-4ca0-9cc5-5c4393c38fe6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:58:10 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:58:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03b906d-9255-480d-a384-b8d5d7c7fa53]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG os_brick.utils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating existing volume attachment record: 1236a696-9d9d-4221-b82a-6355ed95bd60 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:58:10 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Successfully created port: c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Successfully updated port: c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing instance network info cache due to event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.network.neutron [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance network_info: |[{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:58:11 user nova-compute[75463]: DEBUG nova.network.neutron [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:58:12 user nova-compute[75463]: DEBUG nova.network.neutron [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated VIF entry in instance network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:58:12 user nova-compute[75463]: DEBUG nova.network.neutron [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:58:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5483d494-ac0b-4901-a0f8-ffcfb8d70c57 req-97a1fe7e-e136-4003-87e1-465e8b4e01df service nova] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:58:13 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:58:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:18 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8434MB free_disk=24.942665100097656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 621790aa-0d18-490b-adad-cef419c35f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:58:18 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:58:19 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:58:19 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:58:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:58:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:58:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Creating image(s)
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Ensure instance console log exists: /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start _get_guest_xml network_info=[{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '621790aa-0d18-490b-adad-cef419c35f03', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae002ae6-2260-40e2-ab44-c08b22e51e40', 'serial': 'ae002ae6-2260-40e2-ab44-c08b22e51e40'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '1236a696-9d9d-4221-b82a-6355ed95bd60', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:58:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:58:31 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:58:31 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:58:31 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033a6ee-1255-492d-ac39-10b9fe56361b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:58:31 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a3508e-6b56-4400-b285-40353e7107d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40] added
Nov 03 17:58:31 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3884d-7812-4589-8775-c39de6ab0821]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[096122f7-a286-4732-9b19-8a852e8d4b16]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXhwUdKr {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXhwUdKr" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ff654-a29b-44b2-ad7e-2ba3b6ff1d3d]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXhwUdKr'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955f84d-a03d-4106-af38-841150005e3e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e835cf30-f1b7-42bf-b412-91d3effa49c2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:58:31 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 17:58:31 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:58:31 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 17:58:31 user nova-compute[75463]: 
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1df549d-beb0-4574-bb0a-3f2501f58309]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]
Nov 03 17:58:31 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.
Nov 03 17:58:31 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c75ae-44e5-45e2-909c-8f0887ec9dfe]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:58:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[13563016-4dfa-45bb-8121-d9d63edfa5c3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:58:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:58:32 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[84687c73-87bd-45c2-9fc9-0855b20a2d57]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:58:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23962326262366161', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962326262366161', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELnWajfeVRbZmigM8Sq4xp+wKA+KQC0Ob9vkMCHshvuMHn8fmh/T5V2KVsBPknY2D6v0JKaa2xfty+dFwA8fj1e6HdXLyOQ3AjEhrT79r6NkfIHvYdzdG5w5Rm/64nDFw==',key_name='tempest-TestShelveInstance-1297893612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:58:10Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.objects.instance [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'pci_devices' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:58:33 user nova-compute[75463]:   <uuid>621790aa-0d18-490b-adad-cef419c35f03</uuid>
Nov 03 17:58:33 user nova-compute[75463]:   <name>instance-0000002e</name>
Nov 03 17:58:33 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:58:33 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:58:33 user nova-compute[75463]:   <metadata>
Nov 03 17:58:33 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:58:33 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:58:33 user nova-compute[75463]:       <nova:name>tempest-TestShelveInstance-server-1637033815</nova:name>
Nov 03 17:58:33 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:58:31</nova:creationTime>
Nov 03 17:58:33 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:58:33 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:58:33 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:58:33 user nova-compute[75463]:       <nova:owner>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:user uuid="f1b71d43c9e84a738a81e56daf4a14d6">tempest-TestShelveInstance-1649968938-project-member</nova:user>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:project uuid="692ebed50cd34a6abcb2ec108bd28669">tempest-TestShelveInstance-1649968938</nova:project>
Nov 03 17:58:33 user nova-compute[75463]:       </nova:owner>
Nov 03 17:58:33 user nova-compute[75463]:       <nova:ports>
Nov 03 17:58:33 user nova-compute[75463]:         <nova:port uuid="c66d6908-761b-4ecc-aa87-23d1909c84ed">
Nov 03 17:58:33 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 17:58:33 user nova-compute[75463]:         </nova:port>
Nov 03 17:58:33 user nova-compute[75463]:       </nova:ports>
Nov 03 17:58:33 user nova-compute[75463]:     </nova:instance>
Nov 03 17:58:33 user nova-compute[75463]:   </metadata>
Nov 03 17:58:33 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:58:33 user nova-compute[75463]:     <system>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="serial">621790aa-0d18-490b-adad-cef419c35f03</entry>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="uuid">621790aa-0d18-490b-adad-cef419c35f03</entry>
Nov 03 17:58:33 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:58:33 user nova-compute[75463]:     </system>
Nov 03 17:58:33 user nova-compute[75463]:   </sysinfo>
Nov 03 17:58:33 user nova-compute[75463]:   <os>
Nov 03 17:58:33 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:58:33 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:58:33 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:58:33 user nova-compute[75463]:   </os>
Nov 03 17:58:33 user nova-compute[75463]:   <features>
Nov 03 17:58:33 user nova-compute[75463]:     <acpi/>
Nov 03 17:58:33 user nova-compute[75463]:     <apic/>
Nov 03 17:58:33 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:58:33 user nova-compute[75463]:   </features>
Nov 03 17:58:33 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:58:33 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:58:33 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:58:33 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:58:33 user nova-compute[75463]:   </clock>
Nov 03 17:58:33 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:58:33 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:58:33 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:58:33 user nova-compute[75463]:   </cpu>
Nov 03 17:58:33 user nova-compute[75463]:   <devices>
Nov 03 17:58:33 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 17:58:33 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:58:33 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 17:58:33 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:58:33 user nova-compute[75463]:       <serial>ae002ae6-2260-40e2-ab44-c08b22e51e40</serial>
Nov 03 17:58:33 user nova-compute[75463]:     </disk>
Nov 03 17:58:33 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:58:33 user nova-compute[75463]:       <mac address="fa:16:3e:ac:6a:9d"/>
Nov 03 17:58:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:58:33 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:58:33 user nova-compute[75463]:       <target dev="tapc66d6908-76"/>
Nov 03 17:58:33 user nova-compute[75463]:     </interface>
Nov 03 17:58:33 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:58:33 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03/console.log" append="off"/>
Nov 03 17:58:33 user nova-compute[75463]:     </serial>
Nov 03 17:58:33 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:58:33 user nova-compute[75463]:     <video>
Nov 03 17:58:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:58:33 user nova-compute[75463]:     </video>
Nov 03 17:58:33 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:58:33 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:58:33 user nova-compute[75463]:     </rng>
Nov 03 17:58:33 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:58:33 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:58:33 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:58:33 user nova-compute[75463]:     </memballoon>
Nov 03 17:58:33 user nova-compute[75463]:   </devices>
Nov 03 17:58:33 user nova-compute[75463]: </domain>
Nov 03 17:58:33 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELnWajfeVRbZmigM8Sq4xp+wKA+KQC0Ob9vkMCHshvuMHn8fmh/T5V2KVsBPknY2D6v0JKaa2xfty+dFwA8fj1e6HdXLyOQ3AjEhrT79r6NkfIHvYdzdG5w5Rm/64nDFw==',key_name='tempest-TestShelveInstance-1297893612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:58:10Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG os_vif [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc4e1018-9243-51e9-8f6e-72f80c5366c4', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66d6908-76, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66d6908-76, col_values=(('qos', UUID('e8bc7610-948b-43d4-b156-515136a1196a')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66d6908-76, col_values=(('external_ids', {'iface-id': 'c66d6908-761b-4ecc-aa87-23d1909c84ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:6a:9d', 'vm-uuid': '621790aa-0d18-490b-adad-cef419c35f03'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:33 user nova-compute[75463]: INFO os_vif [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76')
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:58:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] No VIF found with MAC fa:16:3e:ac:6a:9d, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG nova.compute.manager [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:58:34 user nova-compute[75463]: WARNING nova.compute.manager [req-4519a7c6-37b4-470b-a6d4-5033914eca4f req-00f9c7c9-0eca-497c-9d04-95f3419179a8 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state building and task_state spawning.
Nov 03 17:58:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 17:58:35 user nova-compute[75463]: INFO nova.compute.claims [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Claim successful on node user
Nov 03 17:58:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 17:58:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.policy [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0b709d13a9d4f9890ea83f286af39c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14461307c664213a54f48a102954cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 17:58:35 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Creating image(s)
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "/opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "/opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.231s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk 1073741824" returned: 0 in 0.055s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Successfully created port: e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Cannot resize image /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Successfully updated port: e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:58:36 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance spawned successfully.
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquired lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:58:36 user nova-compute[75463]: WARNING nova.compute.manager [req-67770100-9cea-465d-9cff-763f4df49c35 req-964eb84c-4f0f-4beb-9679-99b105ca07a0 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state building and task_state spawning.
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-changed-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.compute.manager [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Refreshing instance network info cache due to event network-changed-e7c40f5a-a642-4ee3-a06d-af2cf02db656. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] Acquiring lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:36 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 17:58:37 user nova-compute[75463]: INFO nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:58:37 user nova-compute[75463]: INFO nova.compute.manager [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Took 27.74 seconds to build instance.
Nov 03 17:58:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-7839e394-7bcc-4d6d-be50-92c6d22158c1 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.968s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.neutron [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating instance_info_cache with network_info: [{"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Releasing lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Instance network_info: |[{"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] Acquired lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Refreshing network info cache for port e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Start _get_guest_xml network_info=[{"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 17:58:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1442148342',display_name='tempest-TestServerVolumeAttachmentScenario-server-1442148342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1442148342',id=47,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA00gQCCLNomqM/SVy8N7vEmajAOdkS4BNwGaYU6dZebaQ4FWxUynFBhugbcW0chXolEuU9QeRh2NtwxspZPjMgnJySMngVciRo9j3qt7x8R35E/6YGkzgOa20SRfsddzA==',key_name='tempest-keypair-820180325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a14461307c664213a54f48a102954cb6',ramdisk_id='',reservation_id='r-l2tjshoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-38513420',owner_user_name='tempest-TestServerVolumeAttachmentScenario-38513420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0b709d13a9d4f9890ea83f286af39c0',uuid=b5d94cfe-1100-4fbc-9ca9-78a94d5fc518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converting VIF {"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.objects.instance [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] End _get_guest_xml xml=<domain type="kvm">
Nov 03 17:58:37 user nova-compute[75463]:   <uuid>b5d94cfe-1100-4fbc-9ca9-78a94d5fc518</uuid>
Nov 03 17:58:37 user nova-compute[75463]:   <name>instance-0000002f</name>
Nov 03 17:58:37 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 17:58:37 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 17:58:37 user nova-compute[75463]:   <metadata>
Nov 03 17:58:37 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 17:58:37 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1442148342</nova:name>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:creationTime>2023-11-03 17:58:37</nova:creationTime>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 17:58:37 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 17:58:37 user nova-compute[75463]:       </nova:flavor>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:owner>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:user uuid="f0b709d13a9d4f9890ea83f286af39c0">tempest-TestServerVolumeAttachmentScenario-38513420-project-member</nova:user>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:project uuid="a14461307c664213a54f48a102954cb6">tempest-TestServerVolumeAttachmentScenario-38513420</nova:project>
Nov 03 17:58:37 user nova-compute[75463]:       </nova:owner>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 17:58:37 user nova-compute[75463]:       <nova:ports>
Nov 03 17:58:37 user nova-compute[75463]:         <nova:port uuid="e7c40f5a-a642-4ee3-a06d-af2cf02db656">
Nov 03 17:58:37 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 17:58:37 user nova-compute[75463]:         </nova:port>
Nov 03 17:58:37 user nova-compute[75463]:       </nova:ports>
Nov 03 17:58:37 user nova-compute[75463]:     </nova:instance>
Nov 03 17:58:37 user nova-compute[75463]:   </metadata>
Nov 03 17:58:37 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 17:58:37 user nova-compute[75463]:     <system>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="serial">b5d94cfe-1100-4fbc-9ca9-78a94d5fc518</entry>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="uuid">b5d94cfe-1100-4fbc-9ca9-78a94d5fc518</entry>
Nov 03 17:58:37 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 17:58:37 user nova-compute[75463]:     </system>
Nov 03 17:58:37 user nova-compute[75463]:   </sysinfo>
Nov 03 17:58:37 user nova-compute[75463]:   <os>
Nov 03 17:58:37 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 17:58:37 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 17:58:37 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 17:58:37 user nova-compute[75463]:   </os>
Nov 03 17:58:37 user nova-compute[75463]:   <features>
Nov 03 17:58:37 user nova-compute[75463]:     <acpi/>
Nov 03 17:58:37 user nova-compute[75463]:     <apic/>
Nov 03 17:58:37 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 17:58:37 user nova-compute[75463]:   </features>
Nov 03 17:58:37 user nova-compute[75463]:   <clock offset="utc">
Nov 03 17:58:37 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 17:58:37 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 17:58:37 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 17:58:37 user nova-compute[75463]:   </clock>
Nov 03 17:58:37 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 17:58:37 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 17:58:37 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 17:58:37 user nova-compute[75463]:   </cpu>
Nov 03 17:58:37 user nova-compute[75463]:   <devices>
Nov 03 17:58:37 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 17:58:37 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 17:58:37 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk"/>
Nov 03 17:58:37 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 17:58:37 user nova-compute[75463]:     </disk>
Nov 03 17:58:37 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 17:58:37 user nova-compute[75463]:       <mac address="fa:16:3e:11:c0:c5"/>
Nov 03 17:58:37 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:58:37 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 17:58:37 user nova-compute[75463]:       <target dev="tape7c40f5a-a6"/>
Nov 03 17:58:37 user nova-compute[75463]:     </interface>
Nov 03 17:58:37 user nova-compute[75463]:     <serial type="pty">
Nov 03 17:58:37 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/console.log" append="off"/>
Nov 03 17:58:37 user nova-compute[75463]:     </serial>
Nov 03 17:58:37 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 17:58:37 user nova-compute[75463]:     <video>
Nov 03 17:58:37 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 17:58:37 user nova-compute[75463]:     </video>
Nov 03 17:58:37 user nova-compute[75463]:     <rng model="virtio">
Nov 03 17:58:37 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 17:58:37 user nova-compute[75463]:     </rng>
Nov 03 17:58:37 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 17:58:37 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 17:58:37 user nova-compute[75463]:       <stats period="10"/>
Nov 03 17:58:37 user nova-compute[75463]:     </memballoon>
Nov 03 17:58:37 user nova-compute[75463]:   </devices>
Nov 03 17:58:37 user nova-compute[75463]: </domain>
Nov 03 17:58:37 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1442148342',display_name='tempest-TestServerVolumeAttachmentScenario-server-1442148342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1442148342',id=47,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA00gQCCLNomqM/SVy8N7vEmajAOdkS4BNwGaYU6dZebaQ4FWxUynFBhugbcW0chXolEuU9QeRh2NtwxspZPjMgnJySMngVciRo9j3qt7x8R35E/6YGkzgOa20SRfsddzA==',key_name='tempest-keypair-820180325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a14461307c664213a54f48a102954cb6',ramdisk_id='',reservation_id='r-l2tjshoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-38513420',owner_user_name='tempest-TestServerVolumeAttachmentScenario-38513420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T17:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0b709d13a9d4f9890ea83f286af39c0',uuid=b5d94cfe-1100-4fbc-9ca9-78a94d5fc518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converting VIF {"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG os_vif [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e31cadfb-aff5-5c4f-adb1-f726d0262e2c', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7c40f5a-a6, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7c40f5a-a6, col_values=(('qos', UUID('22c45b8a-80e2-4f7d-beed-d41cf967a9ad')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7c40f5a-a6, col_values=(('external_ids', {'iface-id': 'e7c40f5a-a642-4ee3-a06d-af2cf02db656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:c0:c5', 'vm-uuid': 'b5d94cfe-1100-4fbc-9ca9-78a94d5fc518'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:37 user nova-compute[75463]: INFO os_vif [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6')
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No VIF found with MAC fa:16:3e:11:c0:c5, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updated VIF entry in instance network info cache for port e7c40f5a-a642-4ee3-a06d-af2cf02db656. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG nova.network.neutron [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating instance_info_cache with network_info: [{"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:58:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ea7ca9d1-12e8-4403-b639-5b565e6418a5 req-8dfd4b3d-a613-4c59-9952-4d01091de2c4 service nova] Releasing lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:58:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:58:39 user nova-compute[75463]: WARNING nova.compute.manager [req-92e01f4d-1e52-480d-a000-3b5b6ddc1d74 req-8045f95a-ba2f-440e-8f92-ae61c9372400 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state building and task_state spawning.
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:39 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 17:58:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Instance spawned successfully.
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 17:58:41 user nova-compute[75463]: WARNING nova.compute.manager [req-601fb61c-0da2-4842-80f3-08d02783857f req-e48eead1-a95f-410d-827e-b9fa9b65b2ac service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state building and task_state spawning.
Nov 03 17:58:41 user nova-compute[75463]: INFO nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 03 17:58:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 17:58:41 user nova-compute[75463]: INFO nova.compute.manager [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Took 6.65 seconds to build instance.
Nov 03 17:58:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-3ae5474d-806d-44ae-896b-065c4b24b770 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.785s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:58:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:58:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:11 user nova-compute[75463]: INFO nova.compute.manager [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Attaching volume 14179651-43ea-4833-8dec-805f82be2a4e to /dev/vdb
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.utils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c620fb7-e387-447c-a6a1-4d67393bde31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55c4c5-6291-44e5-99f8-de31b0fef804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdcb59b-2e92-4d30-ba1c-92ea59f25866]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2fdaff-53b0-4fed-97f9-8f08850b96c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:59:11 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:59:11 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf635ed4-5073-4673-92d3-d7eda7eb4b98]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG os_brick.utils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:59:11 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating existing volume attachment record: d41c4c0d-49d8-4aad-8a89-fde50a215f7a {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:59:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 17:59:13 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:59:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:59:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:59:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 17:59:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:17 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:18 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:20 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:59:20 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8187MB free_disk=24.902496337890625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 621790aa-0d18-490b-adad-cef419c35f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 17:59:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing instance network info cache due to event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] Acquiring lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] Acquired lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updated VIF entry in instance network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating instance_info_cache with network_info: [{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:59:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-201e47f0-1f42-4502-a323-7f2148cd2b00 req-90261500-2e60-4ef5-a290-be28d565571c service nova] Releasing lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:24 user nova-compute[75463]: INFO nova.compute.manager [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Attaching volume 7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 to /dev/vdb
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.utils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a406b26e-0c20-4352-b2c2-0bceb37c03ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e83387-9a43-4d87-ac3b-173b0c5dfafa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2534ec-ba81-4cb9-af36-d93694b55591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed85b410-9aa4-4bf3-8aa9-47c6dc0207ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 17:59:24 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 17:59:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82493b22-a6bb-45eb-a915-d706e6a915af]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG os_brick.utils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:59:24 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating existing volume attachment record: 6b318929-812f-4479-b478-975b332fdb96 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 17:59:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:59:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:59:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:59:32 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:59:32 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:59:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c6b1a2-a0d2-403f-861d-2e6f2c4561da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:59:32 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2254c-d5d5-4b5e-9150-810cb89a968b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e] added
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931f567-70a5-41df-a71c-5e71b75d2b3f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c3cc44-c650-435b-ac5b-47534a51029b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqsTxDCc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqsTxDCc" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919a532-1b2e-4933-9238-c9c18a6f5872]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqsTxDCc'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c63f33-3809-4960-9e79-91d6ebf56794]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70605d-b1d6-4fbf-b5c7-6c15581f9ee5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37e5925-657b-40d0-bf87-eb3586e410f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]
Nov 03 17:59:33 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcea782-6dee-4876-9b26-045541476fac]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69cdca-c82c-4caf-8ad6-6c1ca5279696]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:33 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:33 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed73cca-62df-437b-ac75-effe0690cba5]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23861636264633066', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861636264633066', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:59:34 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:59:34 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 17:59:34 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:59:34 user nova-compute[75463]:   <serial>14179651-43ea-4833-8dec-805f82be2a4e</serial>
Nov 03 17:59:34 user nova-compute[75463]: </disk>
Nov 03 17:59:34 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No VIF found with MAC fa:16:3e:23:c5:85, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:59:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1a26bd80-736d-4119-8443-0b991680965b tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.221s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:59:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBQvPjpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 17:59:46 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:59:46 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 17:59:46 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e9d8b-ba24-4c9a-9249-a697fcd3c219]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 17:59:46 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d5665-caad-46dd-8554-4db11a7dbcd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801] added
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa944a03-6281-4724-8d9d-79d02ef4e753]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec66cf2a-1704-4866-8227-458f864d94b6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBQvPjpd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBQvPjpd" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[22880509-a446-4b93-a47b-f41c766eb182]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wBQvPjpd'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69817e4-4bd6-48cf-b657-8776d8e88c40]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c9e62-4210-4e19-bdb1-e1b0fef629d0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b99ca1-0a3b-4b80-a923-38829946039f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260]
Nov 03 17:59:46 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260] successful.
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0b37d-189b-4800-bc03-fdf401872cee]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8287972-6f63-46e4-bcd1-de9f989a6def]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 17:59:46 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 17:59:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de275af-8bc2-4914-a225-6760cf2be221]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 17:59:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBQvPjpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23563393363363066', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563393363363066', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.objects.instance [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 17:59:47 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:59:47 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:59:47 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:59:47 user nova-compute[75463]:   <serial>7c3d6c2b-f729-4bbe-a81c-ba846c1c6801</serial>
Nov 03 17:59:47 user nova-compute[75463]: </disk>
Nov 03 17:59:47 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] No VIF found with MAC fa:16:3e:38:c4:70, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 17:59:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47ebd227-9fe4-4583-878b-922d01ef876b tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.634s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing instance network info cache due to event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated VIF entry in instance network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG nova.network.neutron [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:59:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3ecd5955-10ce-4e32-9745-51a54d8f6149 req-549a131d-812a-4f89-9b38-01b4f638c318 service nova] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 17:59:50 user nova-compute[75463]: INFO nova.compute.manager [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Detaching volume 7c3d6c2b-f729-4bbe-a81c-ba846c1c6801
Nov 03 17:59:50 user nova-compute[75463]: INFO nova.virt.block_device [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Attempting to driver detach volume 7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 from mountpoint /dev/vdb
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Attempting to detach device vdb from instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:59:50 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:59:50 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:59:50 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:59:50 user nova-compute[75463]:   <serial>7c3d6c2b-f729-4bbe-a81c-ba846c1c6801</serial>
Nov 03 17:59:50 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:59:50 user nova-compute[75463]: </disk>
Nov 03 17:59:50 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:59:50 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully detached device vdb from instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 from the persistent domain config.
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 17:59:50 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 17:59:50 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 17:59:50 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 17:59:50 user nova-compute[75463]:   <serial>7c3d6c2b-f729-4bbe-a81c-ba846c1c6801</serial>
Nov 03 17:59:50 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 17:59:50 user nova-compute[75463]: </disk>
Nov 03 17:59:50 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing instance network info cache due to event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 17:59:50 user nova-compute[75463]: DEBUG nova.network.neutron [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 17:59:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated VIF entry in instance network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 17:59:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 17:59:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-4970a7da-c607-4687-8cb5-a978eac9c403 req-a8ffd7db-367b-4e47-9261-36c8047f8dc4 service nova] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 17:59:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 17:59:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:00 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG nova.compute.manager [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing instance network info cache due to event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated VIF entry in instance network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG nova.network.neutron [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8e491fac-bf22-41ee-89a5-87217cf38b7b req-382113e1-bf46-48fa-be56-04843201d2d9 service nova] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:01 user nova-compute[75463]: INFO nova.compute.manager [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Shelve offloading
Nov 03 18:00:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:01 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:01 user nova-compute[75463]: INFO nova.compute.manager [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Rebooting instance
Nov 03 18:00:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:02 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance destroyed successfully.
Nov 03 18:00:02 user nova-compute[75463]: DEBUG nova.compute.manager [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG nova.network.neutron [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.neutron [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:03 user nova-compute[75463]: WARNING nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state active and task_state shelving.
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:03 user nova-compute[75463]: WARNING nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state active and task_state shelving.
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:03 user nova-compute[75463]: WARNING nova.compute.manager [req-5e95814b-6521-4e49-b691-23fe8fa19287 req-a2fef3f3-54f6-4c69-bca9-7c64eb63aaae service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 18:00:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance destroyed successfully.
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'resources' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:00:02Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0912b743-52, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89398861-ee02-4624-bbd4-b3b8906d0081) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: INFO os_vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52')
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:03 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b4390-6d61-4e82-8251-9f9b3bf68e3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:00:03 user nova-compute[75463]: No targets found.
Nov 03 18:00:03 user nova-compute[75463]: iSNS:
Nov 03 18:00:03 user nova-compute[75463]: No targets found.
Nov 03 18:00:03 user nova-compute[75463]: STATIC:
Nov 03 18:00:03 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40
Nov 03 18:00:03 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:03 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:03 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801
Nov 03 18:00:03 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:03 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:03 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:00:03 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:03 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:03 user nova-compute[75463]: FIRMWARE:
Nov 03 18:00:03 user nova-compute[75463]: No targets found.
Nov 03 18:00:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:00:03 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:00:03 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance destroyed successfully.
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'resources' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELnWajfeVRbZmigM8Sq4xp+wKA+KQC0Ob9vkMCHshvuMHn8fmh/T5V2KVsBPknY2D6v0JKaa2xfty+dFwA8fj1e6HdXLyOQ3AjEhrT79r6NkfIHvYdzdG5w5Rm/64nDFw==',key_name='tempest-TestShelveInstance-1297893612',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:58:37Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_vif [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa972a-5457-444e-8345-b47c1355f4d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66d6908-76, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8bc7610-948b-43d4-b156-515136a1196a) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.compute.manager [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing instance network info cache due to event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.network.neutron [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:03 user nova-compute[75463]: INFO os_vif [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76')
Nov 03 18:00:03 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:03 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a5e5bf-87b1-48dd-a4c9-be64ee184fed]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:00:03 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:03 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:00:03 user nova-compute[75463]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:03 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec60a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa9cb38-14bc-4c11-88bd-39b1cbae058a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001723c-bf20-4c5b-8580-f1ade83f8be4]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8763897-ddf0-40ab-a2aa-8adc839bd779]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea90f74-4c35-4059-b74b-23e4c65f3266]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1113a7-1fd2-4440-bffb-64ffc5672b4a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b67b76-65fb-4471-9990-f9b5b12c2730]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]
Nov 03 18:00:03 user nova-compute[75463]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.
Nov 03 18:00:03 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[463556fd-1931-4f02-9166-3006bac1c6b8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== disconnect_volume: return (302ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.225s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start _get_guest_xml network_info=[{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a446b3c-f9dc-4a6f-97b2-babde504b2c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0a446b3c-f9dc-4a6f-97b2-babde504b2c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '169b34f8-40ca-4bad-ba3f-bcef4a67898d', 'attached_at': '', 'detached_at': '', 'volume_id': '14179651-43ea-4833-8dec-805f82be2a4e', 'serial': '14179651-43ea-4833-8dec-805f82be2a4e'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'd41c4c0d-49d8-4aad-8a89-fde50a215f7a', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:00:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:00:04 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8e745-5525-42bb-9ab8-f4e6a1697e5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:00:04 user nova-compute[75463]: No targets found.
Nov 03 18:00:04 user nova-compute[75463]: iSNS:
Nov 03 18:00:04 user nova-compute[75463]: No targets found.
Nov 03 18:00:04 user nova-compute[75463]: STATIC:
Nov 03 18:00:04 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40
Nov 03 18:00:04 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:04 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:04 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801
Nov 03 18:00:04 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:04 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:04 user nova-compute[75463]: FIRMWARE:
Nov 03 18:00:04 user nova-compute[75463]: No targets found.
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:00:04 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:00:04 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0a446b3c-f9dc-4a6f-97b2-babde504b2c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.objects.instance [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'vcpu_model' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3ad05-dde8-4ba2-a52b-13e4cfce1ac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.objects.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Object Instance<169b34f8-40ca-4bad-ba3f-bcef4a67898d> lazy-loaded attributes: resources,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:04 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920bf27-182b-41fc-a328-94b08d22a9b4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec2c2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283ac76-1e2e-43bf-b170-313e6cc14d27]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58264e-7e61-4e0c-b69f-798c51d2c844]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e8177-0c23-4915-91b5-6e1f6556259e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated VIF entry in instance network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.network.neutron [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": null, "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc66d6908-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-3570c68c-6312-4216-b95b-68fab21bcf30 req-ca23f7bb-b098-4eab-9262-cd816b24e655 service nova] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d052e-f7db-4e28-a153-0a995751d50e]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ce633d-1d77-41ef-a322-4ecf11f6b203]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b8073a-c9b5-45f3-9c71-f7ab811ed0ad]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]
Nov 03 18:00:04 user nova-compute[75463]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1fc076-3e14-4b46-b3df-143d6d3ad1c0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== disconnect_volume: return (521ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:00:04 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deleting instance files /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03_del
Nov 03 18:00:04 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deletion of /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03_del complete
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.225s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:04 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:04 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c451d688-ed72-4508-a95c-2901d3f631eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:00:04 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[257fe1a5-023e-4be2-ab4d-0d1b94748667]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e] added
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[14edeab4-eb7e-46ee-8f2e-b0e901f2621b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f6970-3a0c-49c8-b9aa-77ada57e5157]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqsTxDCc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqsTxDCc" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[59248289-2904-485b-aeca-8d07b48a9c5a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqsTxDCc'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b841fb-6fb8-46c7-bd52-9b877095d874]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21485ad5-c501-439b-a013-4b9d507a9d20]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f70d96-17fd-4427-aeca-3a84e2df7133]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]
Nov 03 18:00:04 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2329cfe9-ee66-43d1-9232-705eb290b34f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d894f-986b-42a8-aa76-c906817056aa]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:04 user nova-compute[75463]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:04 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a345d-a41e-42ea-a3d1-10e2c0b2178f]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:00:04 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:00:05 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Deleted allocations for instance 621790aa-0d18-490b-adad-cef419c35f03
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.objects.instance [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'numa_topology' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.objects.base [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Object Instance<621790aa-0d18-490b-adad-cef419c35f03> lazy-loaded attributes: resources,numa_topology {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23861636264633066', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861636264633066', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:05 user nova-compute[75463]: WARNING nova.compute.manager [req-8d178964-1e52-4096-ac11-59f3075cab1e req-6b032103-8bbb-446d-bb8a-d88a5ccd9109 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:00:02Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.objects.instance [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'pci_devices' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.objects.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Object Instance<169b34f8-40ca-4bad-ba3f-bcef4a67898d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:00:05 user nova-compute[75463]:   <uuid>169b34f8-40ca-4bad-ba3f-bcef4a67898d</uuid>
Nov 03 18:00:05 user nova-compute[75463]:   <name>instance-0000002c</name>
Nov 03 18:00:05 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:00:05 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:00:05 user nova-compute[75463]:   <metadata>
Nov 03 18:00:05 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:00:05 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:name>tempest-TestMinimumBasicScenario-server-160404226</nova:name>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:00:04</nova:creationTime>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:00:05 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:00:05 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:owner>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:user uuid="5faa80d6b17442a78b609734e886ab13">tempest-TestMinimumBasicScenario-988383719-project-member</nova:user>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:project uuid="68b6da9208ff44ef8b898e4f0023724a">tempest-TestMinimumBasicScenario-988383719</nova:project>
Nov 03 18:00:05 user nova-compute[75463]:       </nova:owner>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:root type="image" uuid="0a446b3c-f9dc-4a6f-97b2-babde504b2c2"/>
Nov 03 18:00:05 user nova-compute[75463]:       <nova:ports>
Nov 03 18:00:05 user nova-compute[75463]:         <nova:port uuid="0912b743-5213-473e-b72c-da1fccc45c7d">
Nov 03 18:00:05 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 03 18:00:05 user nova-compute[75463]:         </nova:port>
Nov 03 18:00:05 user nova-compute[75463]:       </nova:ports>
Nov 03 18:00:05 user nova-compute[75463]:     </nova:instance>
Nov 03 18:00:05 user nova-compute[75463]:   </metadata>
Nov 03 18:00:05 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:00:05 user nova-compute[75463]:     <system>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="serial">169b34f8-40ca-4bad-ba3f-bcef4a67898d</entry>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="uuid">169b34f8-40ca-4bad-ba3f-bcef4a67898d</entry>
Nov 03 18:00:05 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:00:05 user nova-compute[75463]:     </system>
Nov 03 18:00:05 user nova-compute[75463]:   </sysinfo>
Nov 03 18:00:05 user nova-compute[75463]:   <os>
Nov 03 18:00:05 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:00:05 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:00:05 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:00:05 user nova-compute[75463]:   </os>
Nov 03 18:00:05 user nova-compute[75463]:   <features>
Nov 03 18:00:05 user nova-compute[75463]:     <acpi/>
Nov 03 18:00:05 user nova-compute[75463]:     <apic/>
Nov 03 18:00:05 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:00:05 user nova-compute[75463]:   </features>
Nov 03 18:00:05 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:00:05 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:00:05 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:00:05 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:00:05 user nova-compute[75463]:   </clock>
Nov 03 18:00:05 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:00:05 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:00:05 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:00:05 user nova-compute[75463]:   </cpu>
Nov 03 18:00:05 user nova-compute[75463]:   <devices>
Nov 03 18:00:05 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 18:00:05 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 18:00:05 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk"/>
Nov 03 18:00:05 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:00:05 user nova-compute[75463]:     </disk>
Nov 03 18:00:05 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 18:00:05 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:00:05 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 18:00:05 user nova-compute[75463]:       <target dev="vdb" bus="virtio"/>
Nov 03 18:00:05 user nova-compute[75463]:       <serial>14179651-43ea-4833-8dec-805f82be2a4e</serial>
Nov 03 18:00:05 user nova-compute[75463]:     </disk>
Nov 03 18:00:05 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:00:05 user nova-compute[75463]:       <mac address="fa:16:3e:23:c5:85"/>
Nov 03 18:00:05 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:00:05 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:00:05 user nova-compute[75463]:       <target dev="tap0912b743-52"/>
Nov 03 18:00:05 user nova-compute[75463]:     </interface>
Nov 03 18:00:05 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:00:05 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/console.log" append="off"/>
Nov 03 18:00:05 user nova-compute[75463]:     </serial>
Nov 03 18:00:05 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:00:05 user nova-compute[75463]:     <video>
Nov 03 18:00:05 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:00:05 user nova-compute[75463]:     </video>
Nov 03 18:00:05 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:00:05 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:00:05 user nova-compute[75463]:     </rng>
Nov 03 18:00:05 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:00:05 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:00:05 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:00:05 user nova-compute[75463]:     </memballoon>
Nov 03 18:00:05 user nova-compute[75463]:   </devices>
Nov 03 18:00:05 user nova-compute[75463]: </domain>
Nov 03 18:00:05 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-500c2cda-d235-488b-8c77-64a0895b9bf7 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.137s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.objects.instance [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'trusted_certs' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.objects.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Object Instance<169b34f8-40ca-4bad-ba3f-bcef4a67898d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Cannot resize image /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.objects.instance [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'migration_context' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.objects.base [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Object Instance<169b34f8-40ca-4bad-ba3f-bcef4a67898d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:00:02Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG os_vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '135f60c7-bc7b-5ab2-a010-7250076347a7', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0912b743-52, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0912b743-52, col_values=(('qos', UUID('ea4e6d6b-d618-4057-ae9b-f397014a80e5')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0912b743-52, col_values=(('external_ids', {'iface-id': '0912b743-5213-473e-b72c-da1fccc45c7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:c5:85', 'vm-uuid': '169b34f8-40ca-4bad-ba3f-bcef4a67898d'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:06 user nova-compute[75463]: INFO os_vif [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52')
Nov 03 18:00:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:07 user nova-compute[75463]: WARNING nova.compute.manager [req-ad3829fd-acb0-4d53-b35e-2f0ca142224e req-d305a040-408a-454e-907c-4bc8b2d9809f service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state active and task_state reboot_started_hard.
Nov 03 18:00:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:00:09 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance rebooted successfully.
Nov 03 18:00:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-34cb4620-ef33-4cdb-9782-678916fb9eb3 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.968s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:09 user nova-compute[75463]: WARNING nova.compute.manager [req-56f2fa23-4843-472b-9160-7aed3d8d3662 req-5e123dbf-d682-42f7-b2ab-9270d0fe4ff1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state active and task_state None.
Nov 03 18:00:10 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 is timed out.
Nov 03 18:00:10 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully detached device vdb from instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 from the live domain config.
Nov 03 18:00:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBQvPjpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:10 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff5e431-28f7-4a6b-ba0c-9118f914c5ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:00:10 user nova-compute[75463]: No targets found.
Nov 03 18:00:10 user nova-compute[75463]: iSNS:
Nov 03 18:00:10 user nova-compute[75463]: No targets found.
Nov 03 18:00:10 user nova-compute[75463]: STATIC:
Nov 03 18:00:10 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801
Nov 03 18:00:10 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:10 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:10 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:00:10 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:10 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:10 user nova-compute[75463]: FIRMWARE:
Nov 03 18:00:10 user nova-compute[75463]: No targets found.
Nov 03 18:00:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:00:10 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:00:10 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[37969f48-1240-4224-ba29-881d83c1bf02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[526ffff3-0e30-4e05-a0ac-839941b4a640]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:10 user nova-compute[75463]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 (non-flash)
Nov 03 18:00:10 user nova-compute[75463]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec298af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25020ad-31d9-4265-98d9-7edff8f9f3f0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ccb74-4a9f-455c-929b-23072c2e5bc2]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28fd521-2b9a-46c8-9bc7-77925a4c4137]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dada34-9ffc-4405-bb59-8dc384859989]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804d12c-7e6c-4631-a128-82aaf9e5bff0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede0ae24-615e-43c7-b3da-292d47fb4083]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260]
Nov 03 18:00:10 user nova-compute[75463]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801, portal: 172.16.0.220,3260] successful.
Nov 03 18:00:10 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c3d6c2b-f729-4bbe-a81c-ba846c1c6801 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7546ead7-9b5d-4237-af4d-0f61c2fd0a97]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] <== disconnect_volume: return (316ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:00:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:12 user nova-compute[75463]: DEBUG nova.objects.instance [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'flavor' on Instance uuid 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-643c2060-9783-4cf9-bf4c-681c94c000e8 tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.961s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:00:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:00:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [{"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-a851ebda-8d2a-492f-b1c3-55e17169f606" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:00:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:00:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:00:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=24.891414642333984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:00:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:00:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-changed-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Refreshing instance network info cache due to event network-changed-e7c40f5a-a642-4ee3-a06d-af2cf02db656. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:00:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] Acquiring lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] Acquired lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:25 user nova-compute[75463]: DEBUG nova.network.neutron [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Refreshing network info cache for port e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:00:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updated VIF entry in instance network info cache for port e7c40f5a-a642-4ee3-a06d-af2cf02db656. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:00:26 user nova-compute[75463]: DEBUG nova.network.neutron [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating instance_info_cache with network_info: [{"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ece10dde-c233-4e45-aafa-d5ce6022c81d req-fbe36819-1e80-4926-b865-e591a75c85a6 service nova] Releasing lock "refresh_cache-b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG nova.objects.instance [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:27 user nova-compute[75463]: INFO nova.compute.manager [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attaching volume 3019d2aa-14b5-4c5f-be6f-0c08e6e459ca to /dev/vdb
Nov 03 18:00:27 user nova-compute[75463]: DEBUG os_brick.utils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4777824-7431-46b7-9b3e-09202e6dd14c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[745440fa-af1f-4722-b680-bf51a8d649c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5ed4b-0c23-4709-9386-d0dd384eab44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6947e51-bf20-4345-8dc3-4fb29c3d9fbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:00:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:00:28 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:00:28 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ac14f-5e48-4c28-a2d8-ae9b8910533f]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG os_brick.utils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating existing volume attachment record: e5a88da5-3df9-41fb-86ae-2ba848aa1eba {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:00:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:00:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:00:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:00:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG nova.compute.manager [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG nova.compute.manager [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing instance network info cache due to event network-changed-dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] Acquiring lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] Acquired lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG nova.network.neutron [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Refreshing network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:40 user nova-compute[75463]: INFO nova.compute.manager [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Terminating instance
Nov 03 18:00:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.network.neutron [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updated VIF entry in instance network info cache for port dddeac46-976e-487f-9ee4-fd4f69d5a441. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.network.neutron [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating instance_info_cache with network_info: [{"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b7065942-b6b6-41ed-97c8-cc8f2879e2d3 req-8f14c93a-016d-435b-b4b6-a71074df74e4 service nova] Releasing lock "refresh_cache-44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-unplugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] No waiting events found dispatching network-vif-unplugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.compute.manager [req-95e8cddd-1007-4b2f-8453-057c5725df99 req-f9ab6903-c2ec-4015-9a09-3b31b5bf870b service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-unplugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Instance destroyed successfully.
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.objects.instance [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'resources' on Instance uuid 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1008012237',display_name='tempest-TestStampPattern-server-1008012237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1008012237',id=45,image_ref='22231282-c07b-4b43-b122-631c076ded43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-u3l044s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2bf1471d-815e-4db6-bd76-39f19d901359',image_min_disk='1',image_min_ram='0',image_owner_id='45e79281ae1b44bdbd88ca10c3cc2c89',image_owner_project_name='tempest-TestStampPattern-1270453444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1270453444-project-member',image_user_id='3917b2874c454ef39166a58e155bba9d',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:57:39Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "address": "fa:16:3e:38:c4:70", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddeac46-97", "ovs_interfaceid": "dddeac46-976e-487f-9ee4-fd4f69d5a441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG os_vif [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdddeac46-97, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89a16ab8-08bb-42d2-82d1-c738997540ac) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:41 user nova-compute[75463]: INFO os_vif [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:c4:70,bridge_name='br-int',has_traffic_filtering=True,id=dddeac46-976e-487f-9ee4-fd4f69d5a441,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddeac46-97')
Nov 03 18:00:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Deleting instance files /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56_del
Nov 03 18:00:41 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Deletion of /opt/stack/data/nova/instances/44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56_del complete
Nov 03 18:00:41 user nova-compute[75463]: INFO nova.compute.manager [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 03 18:00:41 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:00:41 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Took 0.42 seconds to deallocate network for instance.
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Deleted allocations for instance 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b30d2a44-b7b0-4115-934f-5fc3e61b56dd tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.compute.manager [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Terminating instance
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] During wait destroy, instance disappeared. {{(pid=75463) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Instance destroyed successfully.
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.objects.instance [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'resources' on Instance uuid a851ebda-8d2a-492f-b1c3-55e17169f606 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1090028409',display_name='tempest-ServerActionsTestOtherA-server-1376365290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1090028409',id=26,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1AfZwh7k3+Aa+ekV9iFc4vdtYdcheXgNcrVDlBwPj/lX2qbd1MLGvloMtCPCTW2ydXVo9USSKtwP9n4iGmSyn4oQwVDl4e3b1qnqC8NlMqQ/jgmeNzZVPfa5EwHLNUhQ==',key_name='tempest-keypair-884601012',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:39:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-k3ij7xgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=a851ebda-8d2a-492f-b1c3-55e17169f606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "address": "fa:16:3e:fe:ac:53", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ad84a4-3d", "ovs_interfaceid": "04ad84a4-3d23-48cf-8188-bbea03ad7bb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_vif [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ad84a4-3d, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:00:42 user nova-compute[75463]: INFO os_vif [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ac:53,bridge_name='br-int',has_traffic_filtering=True,id=04ad84a4-3d23-48cf-8188-bbea03ad7bb2,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ad84a4-3d')
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsaCdeYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:42 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff526e42-2ebf-4bc9-9496-3ef79964160c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:00:42 user nova-compute[75463]: No targets found.
Nov 03 18:00:42 user nova-compute[75463]: iSNS:
Nov 03 18:00:42 user nova-compute[75463]: No targets found.
Nov 03 18:00:42 user nova-compute[75463]: STATIC:
Nov 03 18:00:42 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:00:42 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:00:42 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:00:42 user nova-compute[75463]: FIRMWARE:
Nov 03 18:00:42 user nova-compute[75463]: No targets found.
Nov 03 18:00:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:00:42 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:00:42 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0b8fcf-4b83-4980-bfa1-77d6a74e2898', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.compute.manager [req-658baa81-9b99-4b23-959e-de1c541c3053 req-f8a157b9-2db3-4fff-b136-2168d8611a3b service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-deleted-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[11131369-b3f0-4b41-a7b7-ecf7147d0807]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[772a4d3a-ac79-45e7-a2db-0692bd1426e3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:42 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe014121cf0>, {}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Disconnecting from: [] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== disconnect_volume: return (74ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Deletion of /opt/stack/data/nova/instances/a851ebda-8d2a-492f-b1c3-55e17169f606_del complete
Nov 03 18:00:42 user nova-compute[75463]: INFO nova.compute.manager [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Took 0.16 seconds to destroy the instance on the hypervisor.
Nov 03 18:00:42 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:00:42 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] Acquiring lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] Lock "44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] No waiting events found dispatching network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:00:43 user nova-compute[75463]: WARNING nova.compute.manager [req-65467125-17e4-48d9-9387-d11ec1531c77 req-4bc10f87-d32b-423f-862a-711ae70dbf93 service nova] [instance: 44d13f7d-8dbd-4b4a-8df7-f4fcad6cab56] Received unexpected event network-vif-plugged-dddeac46-976e-487f-9ee4-fd4f69d5a441 for instance with vm_state deleted and task_state None.
Nov 03 18:00:43 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:00:43 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Took 0.66 seconds to deallocate network for instance.
Nov 03 18:00:43 user nova-compute[75463]: INFO nova.compute.manager [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Took 0.08 seconds to detach 1 volumes for instance.
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-342e21e5-a0e7-4a3a-949b-717b5abc5747 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "a851ebda-8d2a-492f-b1c3-55e17169f606" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.224s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:00:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-07ecad98-ff91-4503-aa51-7b4e1027144d req-f56f4551-6e3f-4ab1-b460-072cd375b946 service nova] [instance: a851ebda-8d2a-492f-b1c3-55e17169f606] Received event network-vif-deleted-04ad84a4-3d23-48cf-8188-bbea03ad7bb2 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:00:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:00:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:00:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:00:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfyURPWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:00:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:58 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:00:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:00:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:00:58 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:00:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606fc48-6488-4a30-9492-3ddee8c5a3f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:00:59 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff0c5a-104e-4438-81a7-03fc1d666fc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca] added
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb080ef2-93ba-460c-8395-395ae09ac5d3]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc6acef-ea05-4433-bf13-e9e6d76492c8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfyURPWS {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfyURPWS" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68e5d3-7391-4e11-af1e-7ecfbfe4eece]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfyURPWS'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dff804-06c2-49bc-bb53-165cb86a8983]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd5389-c5f1-4309-b176-5500d614602c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4ac1d-81d8-4269-b02c-88f3c5ecd78f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260]
Nov 03 18:00:59 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260] successful.
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e1fc28-7792-423a-a327-a67954fe0c69]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aee375-a169-4506-9205-3fce5ffa7ae8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:59 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:00:59 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:00:59 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[274d0bc6-a93f-4218-ae31-2eca8d4eed60]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfyURPWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:00:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26338333437326230', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333437326230', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.objects.instance [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:01:00 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:00 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:01:00 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:01:00 user nova-compute[75463]:   <serial>3019d2aa-14b5-4c5f-be6f-0c08e6e459ca</serial>
Nov 03 18:01:00 user nova-compute[75463]: </disk>
Nov 03 18:01:00 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No VIF found with MAC fa:16:3e:11:c0:c5, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:01:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-b69cd518-fad4-4e12-ae39-e02d0f1fc650 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:03 user nova-compute[75463]: INFO nova.compute.manager [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attaching volume 60e3c118-68f1-4974-966d-c6d86cd4e5aa to /dev/vdc
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81140d4-8bb2-4342-b50e-9a13931b7dfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd892e-3928-4c3c-9918-500691f8c9b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77bd476-0403-4bf7-af60-840fdad84009]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195011c-c1f6-4733-89e9-d6d76ed09911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:01:03 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:01:03 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3330d9-7e34-4985-b7a7-cb53e2cdfb3b]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG os_brick.utils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:01:03 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating existing volume attachment record: 8ef93a2e-fd8b-4d87-b109-1ba2a7ba341e {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:01:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:01:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:01:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:01:14 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:01:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:01:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:01:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:01:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:01:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:19 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:01:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:01:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=24.890640258789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 2bf1471d-815e-4db6-bd76-39f19d901359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:01:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHkehxbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:01:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:01:24 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:01:24 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[628a07b4-07c2-4351-87d3-49a13cff007c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:01:24 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[393d4f7c-965f-4234-ae8c-09f856eed989]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa] added
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[668bac83-3eac-403f-8816-d588e1345246]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389de4e-6d1e-4e7a-80e3-e1ac4d25d691]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHkehxbF {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHkehxbF" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[036bd7ee-ae40-448c-b17d-03c4a554380a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHkehxbF'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc21474-a1ce-49d5-8347-445ee9ab848b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1830c0aa-4724-487e-8ec8-501c7bc7577f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee8ff5-a020-4de8-bfbd-dd6265664535]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260]
Nov 03 18:01:24 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260] successful.
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97eec86-af6e-4f6e-b042-5dc7010c3053]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812c4bc-aac3-4d96-b1b3-e5411e2f229b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:24 user nova-compute[75463]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)
Nov 03 18:01:24 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce854600-5ffb-4751-a848-d1bf7484c356]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:01:24 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHkehxbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:01:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:01:25 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23636323466333362', 'path': '/dev/sdd'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:01:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636323466333362', 'path': '/dev/sdd'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:01:25 user nova-compute[75463]: DEBUG nova.objects.instance [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:01:25 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:01:25 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:25 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 18:01:25 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 18:01:25 user nova-compute[75463]:   <serial>60e3c118-68f1-4974-966d-c6d86cd4e5aa</serial>
Nov 03 18:01:25 user nova-compute[75463]: </disk>
Nov 03 18:01:25 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] No VIF found with MAC fa:16:3e:11:c0:c5, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-4cf21be3-3094-43f9-8da4-71d1a1895135 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.215s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:27 user nova-compute[75463]: INFO nova.compute.manager [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Detaching volume 60e3c118-68f1-4974-966d-c6d86cd4e5aa
Nov 03 18:01:27 user nova-compute[75463]: INFO nova.virt.block_device [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attempting to driver detach volume 60e3c118-68f1-4974-966d-c6d86cd4e5aa from mountpoint /dev/vdc
Nov 03 18:01:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Attempting to detach device vdc from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:01:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:01:27 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:27 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 18:01:27 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 18:01:27 user nova-compute[75463]:   <serial>60e3c118-68f1-4974-966d-c6d86cd4e5aa</serial>
Nov 03 18:01:27 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 18:01:27 user nova-compute[75463]: </disk>
Nov 03 18:01:27 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:01:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully detached device vdc from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the persistent domain config.
Nov 03 18:01:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:01:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:01:27 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:27 user nova-compute[75463]:   <source dev="/dev/sdd"/>
Nov 03 18:01:27 user nova-compute[75463]:   <target dev="vdc" bus="virtio"/>
Nov 03 18:01:27 user nova-compute[75463]:   <serial>60e3c118-68f1-4974-966d-c6d86cd4e5aa</serial>
Nov 03 18:01:27 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 03 18:01:27 user nova-compute[75463]: </disk>
Nov 03 18:01:27 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:01:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:01:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:01:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:47 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 is timed out.
Nov 03 18:01:47 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully detached device vdc from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the live domain config.
Nov 03 18:01:47 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHkehxbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:01:47 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b35a4-21c1-4d7d-9e51-e5537dfe079b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:01:47 user nova-compute[75463]: No targets found.
Nov 03 18:01:47 user nova-compute[75463]: iSNS:
Nov 03 18:01:47 user nova-compute[75463]: No targets found.
Nov 03 18:01:47 user nova-compute[75463]: STATIC:
Nov 03 18:01:47 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:01:47 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:01:47 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:01:47 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca
Nov 03 18:01:47 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:01:47 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:01:47 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa
Nov 03 18:01:47 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:01:47 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:01:47 user nova-compute[75463]: FIRMWARE:
Nov 03 18:01:47 user nova-compute[75463]: No targets found.
Nov 03 18:01:47 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:01:47 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:01:47 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c31a2-0eb4-457e-a2bd-a9e50b49ab3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6645381-9355-4ddc-8622-378938a16539]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:47 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:47 user nova-compute[75463]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)
Nov 03 18:01:47 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:01:47 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:01:47 user nova-compute[75463]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa (non-flash)
Nov 03 18:01:47 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec29a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa'): ({'sdd'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Removing single pathed devices sdd {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64fd464-add4-47e0-9411-7e52bd77d621]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f9eb2-f0e7-4608-9d19-5c2c361ec488]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Flushing IO for device /dev/sdd {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[54924bd8-24fa-4121-a078-0d93ef3ff00c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a8766-b8be-4b37-9c84-14d2ba6efcce]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] SCSI volumes sdd have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[41315f2c-4a79-4e0e-ba76-dcc66e5ac0e8]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[794222cd-37ec-47bd-8d9f-9de749a93b09]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260]
Nov 03 18:01:47 user nova-compute[75463]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa, portal: 172.16.0.220,3260] successful.
Nov 03 18:01:47 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:47 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e3c118-68f1-4974-966d-c6d86cd4e5aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70146ded-1813-4bf9-b981-c264b3427247]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== disconnect_volume: return (303ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG nova.objects.instance [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:01:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-8184e108-8764-499f-b189-9e3151bbd8c7 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:53 user nova-compute[75463]: INFO nova.compute.manager [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Unshelving
Nov 03 18:01:53 user nova-compute[75463]: INFO nova.virt.block_device [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Booting with volume ae002ae6-2260-40e2-ab44-c08b22e51e40 at /dev/vda
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c212e3-1e28-4bc0-af6a-423712c1d975]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[adba9ca8-1080-413d-90ee-53df1b2c045a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e387d7-c6c0-476f-877c-cfe248ac7a33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de099a6-e6ba-4c1b-8ffb-2c3f2ab3a542]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:01:53 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:01:53 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[49954b06-b2f7-40f0-bbed-ce286c31deb2]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG os_brick.utils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:01:53 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating existing volume attachment record: 2c624600-b85d-400c-bcdc-2b33821cf1be {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing instance network info cache due to event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing instance network info cache due to event network-changed-07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] Acquiring lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] Acquired lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Refreshing network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:54 user nova-compute[75463]: INFO nova.compute.manager [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Terminating instance
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated VIF entry in instance network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d33db1d8-37b3-4bf9-be22-dda74048c9e8 req-e79f9164-be2c-4c42-b184-8e2de2388a66 service nova] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-ec677a54-93c7-4881-aef1-5f620f673c6a req-30f9e41c-e0ba-49ae-b4e2-ffad26b47ebb service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updated VIF entry in instance network info cache for port 07eb9fa9-3eee-443b-93a9-6be26091c599. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [{"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:01:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb6edc73-463c-413c-b39c-0e352dd95065 req-e7a3c4af-1fef-4057-88db-c35f3168b295 service nova] Releasing lock "refresh_cache-2bf1471d-815e-4db6-bd76-39f19d901359" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Instance destroyed successfully.
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.objects.instance [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lazy-loading 'resources' on Instance uuid 2bf1471d-815e-4db6-bd76-39f19d901359 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:54:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1612767726',display_name='tempest-TestStampPattern-server-1612767726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1612767726',id=42,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoBAz/7Q8pHmp1b36E7vaOmrIyPSVnVvvvXuHAlbLKMh6gPV0h7OuySJdvjrAahDazUpRLuMja2LLx3gArOx0M30ZWaRExalfdUU6Kxu5d6GqM1ABEtCfKJgarWspPZQ==',key_name='tempest-TestStampPattern-1448082266',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45e79281ae1b44bdbd88ca10c3cc2c89',ramdisk_id='',reservation_id='r-s108x7v2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1270453444',owner_user_name='tempest-TestStampPattern-1270453444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:57:29Z,user_data=None,user_id='3917b2874c454ef39166a58e155bba9d',uuid=2bf1471d-815e-4db6-bd76-39f19d901359,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converting VIF {"id": "07eb9fa9-3eee-443b-93a9-6be26091c599", "address": "fa:16:3e:db:bb:b3", "network": {"id": "a15d3360-123d-4993-a728-bdc823474454", "bridge": "br-int", "label": "tempest-TestStampPattern-1636068291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45e79281ae1b44bdbd88ca10c3cc2c89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07eb9fa9-3e", "ovs_interfaceid": "07eb9fa9-3eee-443b-93a9-6be26091c599", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG os_vif [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07eb9fa9-3e, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc7bdc94-ebe1-4c1c-afee-d6e3c0c06efd) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: INFO os_vif [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bb:b3,bridge_name='br-int',has_traffic_filtering=True,id=07eb9fa9-3eee-443b-93a9-6be26091c599,network=Network(a15d3360-123d-4993-a728-bdc823474454),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07eb9fa9-3e')
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Deleting instance files /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359_del
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Deletion of /opt/stack/data/nova/instances/2bf1471d-815e-4db6-bd76-39f19d901359_del complete
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.compute.manager [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 03 18:01:55 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.compute.manager [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Detaching volume 14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.virt.block_device [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Attempting to driver detach volume 14179651-43ea-4833-8dec-805f82be2a4e from mountpoint /dev/vdb
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Attempting to detach device vdb from instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:01:55 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:55 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:01:55 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:01:55 user nova-compute[75463]:   <serial>14179651-43ea-4833-8dec-805f82be2a4e</serial>
Nov 03 18:01:55 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 18:01:55 user nova-compute[75463]: </disk>
Nov 03 18:01:55 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:01:55 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully detached device vdb from instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d from the persistent domain config.
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:01:55 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:01:55 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:01:55 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:01:55 user nova-compute[75463]:   <serial>14179651-43ea-4833-8dec-805f82be2a4e</serial>
Nov 03 18:01:55 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 03 18:01:55 user nova-compute[75463]: </disk>
Nov 03 18:01:55 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:01:56 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Took 0.57 seconds to deallocate network for instance.
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing instance network info cache due to event network-changed-0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Refreshing network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Deleted allocations for instance 2bf1471d-815e-4db6-bd76-39f19d901359
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-53e70f8a-95d5-4da4-864f-6db5e42c316e tempest-TestStampPattern-1270453444 tempest-TestStampPattern-1270453444-project-member] Lock "2bf1471d-815e-4db6-bd76-39f19d901359" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated VIF entry in instance network info cache for port 0912b743-5213-473e-b72c-da1fccc45c7d. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.network.neutron [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-fbd2c594-0a95-4104-9d0a-274fa856a0c0 req-0291fa23-c2ff-4efb-bf8a-d874c9d0e082 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-deleted-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a10237cb-24a8-47ac-97e8-55d90551b7b7 req-2b25480d-7c54-4a6e-af65-fdfdb65db725 service nova] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:56 user nova-compute[75463]: WARNING nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state deleted and task_state None.
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:56 user nova-compute[75463]: WARNING nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state deleted and task_state None.
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:56 user nova-compute[75463]: WARNING nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state deleted and task_state None.
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:56 user nova-compute[75463]: WARNING nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-unplugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state deleted and task_state None.
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Acquiring lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] Lock "2bf1471d-815e-4db6-bd76-39f19d901359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:01:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] No waiting events found dispatching network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:01:56 user nova-compute[75463]: WARNING nova.compute.manager [req-e135a5c3-c2d4-4e56-bf1c-b2270c4cbbaf req-2442f7aa-549b-49df-954a-aab09c08def2 service nova] [instance: 2bf1471d-815e-4db6-bd76-39f19d901359] Received unexpected event network-vif-plugged-07eb9fa9-3eee-443b-93a9-6be26091c599 for instance with vm_state deleted and task_state None.
Nov 03 18:01:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:01:59 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'pci_requests' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'numa_topology' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:02:14 user nova-compute[75463]: INFO nova.compute.claims [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Claim successful on node user
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:15 user nova-compute[75463]: INFO nova.network.neutron [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating port c66d6908-761b-4ecc-aa87-23d1909c84ed with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing instance network info cache due to event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:02:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:02:16 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d is timed out.
Nov 03 18:02:16 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully detached device vdb from instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d from the live domain config.
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqsTxDCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:02:16 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e5cc61-6a47-4b38-ab62-703fd9269b45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:02:16 user nova-compute[75463]: No targets found.
Nov 03 18:02:16 user nova-compute[75463]: iSNS:
Nov 03 18:02:16 user nova-compute[75463]: No targets found.
Nov 03 18:02:16 user nova-compute[75463]: STATIC:
Nov 03 18:02:16 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e
Nov 03 18:02:16 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:02:16 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:02:16 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca
Nov 03 18:02:16 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:02:16 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:02:16 user nova-compute[75463]: FIRMWARE:
Nov 03 18:02:16 user nova-compute[75463]: No targets found.
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:02:16 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:02:16 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [{"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec3f76a-5451-4297-a6ea-09b86c355f71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-169b34f8-40ca-4bad-ba3f-bcef4a67898d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c9c3c-4089-4a9b-abb0-f56d8d457831]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:02:16 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e (non-flash)
Nov 03 18:02:16 user nova-compute[75463]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe01421f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[071acfcb-75ae-410a-9762-e138238c9d91]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4ca3bf-80c2-4c55-a775-1d44e602d8c1]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86b4f94-8eb7-4598-8e91-4e1b19770c92]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:02:16 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Creating image(s)
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Ensure instance console log exists: /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start _get_guest_xml network_info=[{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '621790aa-0d18-490b-adad-cef419c35f03', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae002ae6-2260-40e2-ab44-c08b22e51e40', 'serial': 'ae002ae6-2260-40e2-ab44-c08b22e51e40'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '2c624600-b85d-400c-bcdc-2b33821cf1be', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.network.neutron [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:02:16 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:02:16 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca19159a-5cef-4716-b62a-ed48a39e21b9]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'vcpu_model' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[73778c0d-1b4d-4fea-8e1d-8fb571ea642c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.objects.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Object Instance<621790aa-0d18-490b-adad-cef419c35f03> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:02:16 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2259fda-1fbb-4aa6-99c8-93048c5404de]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260]
Nov 03 18:02:16 user nova-compute[75463]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e, portal: 172.16.0.220,3260] successful.
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14179651-43ea-4833-8dec-805f82be2a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a9e5d-3e68-48c9-a0d9-d47b98e802c1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== disconnect_volume: return (284ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.054s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:02:16 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:02:16 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bb2763-ca90-4bdc-b477-d40619005436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:02:16 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f1d0e-5b93-4882-afb0-cd743110283f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40] added
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14340d-5687-44c8-99a9-90eb475109e6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd5e329-9a97-4f97-ab8f-c746ff90761e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXhwUdKr {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXhwUdKr" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259bb4e-088d-4078-a8be-ddc9c05fde0a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXhwUdKr'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f924a-75b6-4682-8d2c-c106f87b0bc2]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c6c1a4-fae5-4120-a6c1-c1d620f846b5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d208ba-2deb-4bcb-8811-7a11085535bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]
Nov 03 18:02:16 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3645abcd-067a-4e0d-acfb-0c1e76796dd6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1bb64-3e80-4530-a336-4dec3749c162]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:16 user nova-compute[75463]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:02:16 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.network.neutron [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated VIF entry in instance network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG nova.network.neutron [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c04af-682b-4b01-9136-211c46be8717]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:02:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-2b15be75-0a82-432d-b763-74a5874e9c13 req-6f2e3049-84a0-4cae-9ba7-075e57ae5384 service nova] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.objects.instance [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:17 user nova-compute[75463]: INFO nova.compute.manager [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Detaching volume 3019d2aa-14b5-4c5f-be6f-0c08e6e459ca
Nov 03 18:02:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-1b08d3c5-b963-4d10-9398-fbc089f19146 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.088s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:17 user nova-compute[75463]: INFO nova.virt.block_device [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Attempting to driver detach volume 3019d2aa-14b5-4c5f-be6f-0c08e6e459ca from mountpoint /dev/vdb
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Attempting to detach device vdb from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:02:17 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:02:17 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:02:17 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:02:17 user nova-compute[75463]:   <serial>3019d2aa-14b5-4c5f-be6f-0c08e6e459ca</serial>
Nov 03 18:02:17 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:02:17 user nova-compute[75463]: </disk>
Nov 03 18:02:17 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23962326262366161', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962326262366161', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:02:17 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully detached device vdb from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the persistent domain config.
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:02:17 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:02:17 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:02:17 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:02:17 user nova-compute[75463]:   <serial>3019d2aa-14b5-4c5f-be6f-0c08e6e459ca</serial>
Nov 03 18:02:17 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:02:17 user nova-compute[75463]: </disk>
Nov 03 18:02:17 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1297893612',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:01:54Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'pci_devices' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.objects.base [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Object Instance<621790aa-0d18-490b-adad-cef419c35f03> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:02:17 user nova-compute[75463]:   <uuid>621790aa-0d18-490b-adad-cef419c35f03</uuid>
Nov 03 18:02:17 user nova-compute[75463]:   <name>instance-0000002e</name>
Nov 03 18:02:17 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:02:17 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:02:17 user nova-compute[75463]:   <metadata>
Nov 03 18:02:17 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:02:17 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:02:17 user nova-compute[75463]:       <nova:name>tempest-TestShelveInstance-server-1637033815</nova:name>
Nov 03 18:02:17 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:02:16</nova:creationTime>
Nov 03 18:02:17 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:02:17 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:02:17 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:02:17 user nova-compute[75463]:       <nova:owner>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:user uuid="f1b71d43c9e84a738a81e56daf4a14d6">tempest-TestShelveInstance-1649968938-project-member</nova:user>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:project uuid="692ebed50cd34a6abcb2ec108bd28669">tempest-TestShelveInstance-1649968938</nova:project>
Nov 03 18:02:17 user nova-compute[75463]:       </nova:owner>
Nov 03 18:02:17 user nova-compute[75463]:       <nova:ports>
Nov 03 18:02:17 user nova-compute[75463]:         <nova:port uuid="c66d6908-761b-4ecc-aa87-23d1909c84ed">
Nov 03 18:02:17 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 03 18:02:17 user nova-compute[75463]:         </nova:port>
Nov 03 18:02:17 user nova-compute[75463]:       </nova:ports>
Nov 03 18:02:17 user nova-compute[75463]:     </nova:instance>
Nov 03 18:02:17 user nova-compute[75463]:   </metadata>
Nov 03 18:02:17 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:02:17 user nova-compute[75463]:     <system>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="serial">621790aa-0d18-490b-adad-cef419c35f03</entry>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="uuid">621790aa-0d18-490b-adad-cef419c35f03</entry>
Nov 03 18:02:17 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:02:17 user nova-compute[75463]:     </system>
Nov 03 18:02:17 user nova-compute[75463]:   </sysinfo>
Nov 03 18:02:17 user nova-compute[75463]:   <os>
Nov 03 18:02:17 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:02:17 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:02:17 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:02:17 user nova-compute[75463]:   </os>
Nov 03 18:02:17 user nova-compute[75463]:   <features>
Nov 03 18:02:17 user nova-compute[75463]:     <acpi/>
Nov 03 18:02:17 user nova-compute[75463]:     <apic/>
Nov 03 18:02:17 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:02:17 user nova-compute[75463]:   </features>
Nov 03 18:02:17 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:02:17 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:02:17 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:02:17 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:02:17 user nova-compute[75463]:   </clock>
Nov 03 18:02:17 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:02:17 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:02:17 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:02:17 user nova-compute[75463]:   </cpu>
Nov 03 18:02:17 user nova-compute[75463]:   <devices>
Nov 03 18:02:17 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 18:02:17 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:02:17 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 18:02:17 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:02:17 user nova-compute[75463]:       <serial>ae002ae6-2260-40e2-ab44-c08b22e51e40</serial>
Nov 03 18:02:17 user nova-compute[75463]:     </disk>
Nov 03 18:02:17 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:02:17 user nova-compute[75463]:       <mac address="fa:16:3e:ac:6a:9d"/>
Nov 03 18:02:17 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:02:17 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:02:17 user nova-compute[75463]:       <target dev="tapc66d6908-76"/>
Nov 03 18:02:17 user nova-compute[75463]:     </interface>
Nov 03 18:02:17 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:02:17 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03/console.log" append="off"/>
Nov 03 18:02:17 user nova-compute[75463]:     </serial>
Nov 03 18:02:17 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:02:17 user nova-compute[75463]:     <video>
Nov 03 18:02:17 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:02:17 user nova-compute[75463]:     </video>
Nov 03 18:02:17 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:02:17 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:02:17 user nova-compute[75463]:     </rng>
Nov 03 18:02:17 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:02:17 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:02:17 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:02:17 user nova-compute[75463]:     </memballoon>
Nov 03 18:02:17 user nova-compute[75463]:   </devices>
Nov 03 18:02:17 user nova-compute[75463]: </domain>
Nov 03 18:02:17 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1297893612',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:01:54Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG os_vif [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc4e1018-9243-51e9-8f6e-72f80c5366c4', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66d6908-76, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66d6908-76, col_values=(('qos', UUID('cbb53148-6e06-4f0e-a47c-19fb12dc9e43')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66d6908-76, col_values=(('external_ids', {'iface-id': 'c66d6908-761b-4ecc-aa87-23d1909c84ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:6a:9d', 'vm-uuid': '621790aa-0d18-490b-adad-cef419c35f03'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:17 user nova-compute[75463]: INFO os_vif [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76')
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:02:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] No VIF found with MAC fa:16:3e:ac:6a:9d, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:02:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:02:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:02:19 user nova-compute[75463]: WARNING nova.compute.manager [req-d2e51f13-e929-4f60-a1a2-1bd4455622d7 req-2bf033e8-238e-448d-a6a9-017d14e9f754 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:02:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance spawned successfully.
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:02:21 user nova-compute[75463]: WARNING nova.compute.manager [req-7180c96f-f2e8-4289-9f64-168a68366c5f req-614ecc51-25fa-4312-a4db-7792583ded67 service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state shelved_offloaded and task_state spawning.
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9bd141a4-d29a-4c32-bfca-30edbcbdf341 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.201s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:02:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=25.01226806640625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 621790aa-0d18-490b-adad-cef419c35f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:02:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:02:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:38 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 is timed out.
Nov 03 18:02:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully detached device vdb from instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 from the live domain config.
Nov 03 18:02:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfyURPWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:02:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e0e86-bbb3-4ca8-ac0e-255e5cd5fb63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:02:38 user nova-compute[75463]: No targets found.
Nov 03 18:02:38 user nova-compute[75463]: iSNS:
Nov 03 18:02:38 user nova-compute[75463]: No targets found.
Nov 03 18:02:38 user nova-compute[75463]: STATIC:
Nov 03 18:02:38 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40
Nov 03 18:02:38 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:02:38 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:02:38 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca
Nov 03 18:02:38 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:02:38 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:02:38 user nova-compute[75463]: FIRMWARE:
Nov 03 18:02:38 user nova-compute[75463]: No targets found.
Nov 03 18:02:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:02:38 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:02:38 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec2296-d34c-47f1-80c6-37f8cd0952db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2addf0-31ef-4931-a967-766a46fedb13]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:38 user nova-compute[75463]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:02:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca (non-flash)
Nov 03 18:02:38 user nova-compute[75463]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:02:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c211e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0778131-cd74-4b05-828a-ab52823f5167]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727570b-892c-44bb-b831-bce75eece5c5]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[878db36d-c190-42dd-a160-c1faf4877fa0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea7dbb-3cb7-4555-891e-e4db09085db4]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f455f5-3134-46ec-9c3a-445ae9985c23]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc3946-03a3-4b3b-b327-80230a754104]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260]
Nov 03 18:02:38 user nova-compute[75463]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca, portal: 172.16.0.220,3260] successful.
Nov 03 18:02:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3019d2aa-14b5-4c5f-be6f-0c08e6e459ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b153d1-4fae-45ea-9c93-5d8964e5fdf0]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] <== disconnect_volume: return (281ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:02:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:02:39 user nova-compute[75463]: DEBUG nova.objects.instance [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'flavor' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be32164c-1de5-4672-9e35-ba75fd684470 tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:02:52 user nova-compute[75463]: INFO nova.compute.claims [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Claim successful on node user
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 18:02:52 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.policy [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '439941527e584c22a684399b2b30a6d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310c11a9e2a4e17851e9f0367b6adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 18:02:52 user nova-compute[75463]: INFO nova.virt.block_device [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Booting with volume 47d88802-fa88-4c46-9ac2-3dfe8744669a at /dev/vda
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.utils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ad871-d0ed-4c3f-89a6-916dc8e9e00c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda41f4f-39f0-4000-9ace-a9fa24e8a162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af12d98-7de8-4731-9fc3-f24aea31d6d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c771f8a-4ec4-46b5-8ddc-6c34d73d3dca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:02:52 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:02:52 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1015adc5-44db-42d8-9944-c714324f00c3]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG os_brick.utils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating existing volume attachment record: c189ca56-0811-48cb-8fb7-47e8a23ec1d7 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:02:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Successfully created port: eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 18:02:53 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Successfully updated port: eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-changed-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Refreshing instance network info cache due to event network-changed-eb70b080-f097-4e9c-a275-a6d9812f8d12. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance network_info: |[{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:02:54 user nova-compute[75463]: DEBUG nova.network.neutron [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Refreshing network info cache for port eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:02:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updated VIF entry in instance network info cache for port eb70b080-f097-4e9c-a275-a6d9812f8d12. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:02:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-62079738-acc0-42d2-abaa-5cc4e885c7dd req-8890dd02-d9ba-40a1-b520-2a8b8efb1dd9 service nova] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:02:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:57 user nova-compute[75463]: INFO nova.compute.manager [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Terminating instance
Nov 03 18:02:57 user nova-compute[75463]: DEBUG nova.compute.manager [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-88a90bf1-a446-41d9-ac02-e694de5fc1d1 req-d82c4d7a-6db0-4233-8faf-536c1f2bef43 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Instance destroyed successfully.
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.objects.instance [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'resources' on Instance uuid 169b34f8-40ca-4bad-ba3f-bcef4a67898d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-160404226',display_name='tempest-TestMinimumBasicScenario-server-160404226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-160404226',id=44,image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZVKaW5SVEmll7ckXz0MkmHSCRYpYMCgIeO7oAfwocDszTi1taWz+/06GJ0PtDA5K4R61zJp1CyQ/50ZZ6W0jIS8pcKm5Ycd/Sy/atOepiPJ2oja1vBewfcbXAQxCjcw==',key_name='tempest-TestMinimumBasicScenario-854141548',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-p72xxdks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0a446b3c-f9dc-4a6f-97b2-babde504b2c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:00:10Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=169b34f8-40ca-4bad-ba3f-bcef4a67898d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "0912b743-5213-473e-b72c-da1fccc45c7d", "address": "fa:16:3e:23:c5:85", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912b743-52", "ovs_interfaceid": "0912b743-5213-473e-b72c-da1fccc45c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG os_vif [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0912b743-52, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea4e6d6b-d618-4057-ae9b-f397014a80e5) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: INFO os_vif [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c5:85,bridge_name='br-int',has_traffic_filtering=True,id=0912b743-5213-473e-b72c-da1fccc45c7d,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912b743-52')
Nov 03 18:02:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Deleting instance files /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d_del
Nov 03 18:02:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Deletion of /opt/stack/data/nova/instances/169b34f8-40ca-4bad-ba3f-bcef4a67898d_del complete
Nov 03 18:02:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:58 user nova-compute[75463]: INFO nova.compute.manager [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 03 18:02:58 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:02:58 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:02:59 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Took 0.86 seconds to deallocate network for instance.
Nov 03 18:02:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:02:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:02:59 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Deleted allocations for instance 169b34f8-40ca-4bad-ba3f-bcef4a67898d
Nov 03 18:02:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-104cdae7-45b8-4f39-83dd-ea7fe2d69184 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:00 user nova-compute[75463]: WARNING nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state deleted and task_state None.
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:00 user nova-compute[75463]: WARNING nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state deleted and task_state None.
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:00 user nova-compute[75463]: WARNING nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state deleted and task_state None.
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:00 user nova-compute[75463]: WARNING nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-unplugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state deleted and task_state None.
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Acquiring lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] Lock "169b34f8-40ca-4bad-ba3f-bcef4a67898d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] No waiting events found dispatching network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:00 user nova-compute[75463]: WARNING nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received unexpected event network-vif-plugged-0912b743-5213-473e-b72c-da1fccc45c7d for instance with vm_state deleted and task_state None.
Nov 03 18:03:00 user nova-compute[75463]: DEBUG nova.compute.manager [req-ff1004eb-9407-4cb8-8706-cadb6dedd80a req-c11837d8-b95f-4e28-a4aa-5511fd6511f1 service nova] [instance: 169b34f8-40ca-4bad-ba3f-bcef4a67898d] Received event network-vif-deleted-0912b743-5213-473e-b72c-da1fccc45c7d {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:01 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:08 user nova-compute[75463]: INFO nova.compute.manager [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Terminating instance
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.compute.manager [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-aae475e4-f633-49bb-901e-90074e2b98e6 req-24cb679c-fe16-465c-8505-2e7afccf8f1b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Instance destroyed successfully.
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.objects.instance [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lazy-loading 'resources' on Instance uuid b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1442148342',display_name='tempest-TestServerVolumeAttachmentScenario-server-1442148342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1442148342',id=47,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA00gQCCLNomqM/SVy8N7vEmajAOdkS4BNwGaYU6dZebaQ4FWxUynFBhugbcW0chXolEuU9QeRh2NtwxspZPjMgnJySMngVciRo9j3qt7x8R35E/6YGkzgOa20SRfsddzA==',key_name='tempest-keypair-820180325',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a14461307c664213a54f48a102954cb6',ramdisk_id='',reservation_id='r-l2tjshoa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-38513420',owner_user_name='tempest-TestServerVolumeAttachmentScenario-38513420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0b709d13a9d4f9890ea83f286af39c0',uuid=b5d94cfe-1100-4fbc-9ca9-78a94d5fc518,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converting VIF {"id": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "address": "fa:16:3e:11:c0:c5", "network": {"id": "ae85afcc-cee6-4a15-8c93-83c6207595b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1071359971-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a14461307c664213a54f48a102954cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7c40f5a-a6", "ovs_interfaceid": "e7c40f5a-a642-4ee3-a06d-af2cf02db656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG os_vif [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7c40f5a-a6, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22c45b8a-80e2-4f7d-beed-d41cf967a9ad) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:08 user nova-compute[75463]: INFO os_vif [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:c0:c5,bridge_name='br-int',has_traffic_filtering=True,id=e7c40f5a-a642-4ee3-a06d-af2cf02db656,network=Network(ae85afcc-cee6-4a15-8c93-83c6207595b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7c40f5a-a6')
Nov 03 18:03:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Deleting instance files /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518_del
Nov 03 18:03:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Deletion of /opt/stack/data/nova/instances/b5d94cfe-1100-4fbc-9ca9-78a94d5fc518_del complete
Nov 03 18:03:08 user nova-compute[75463]: INFO nova.compute.manager [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 03 18:03:08 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:03:08 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:09 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Took 0.85 seconds to deallocate network for instance.
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fc9ecd1-54b1-4491-9a7e-f6e3171fcc8d req-bb445d9a-f711-4716-93a1-eb568aeb4fdc service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-deleted-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:09 user nova-compute[75463]: INFO nova.compute.manager [req-0fc9ecd1-54b1-4491-9a7e-f6e3171fcc8d req-bb445d9a-f711-4716-93a1-eb568aeb4fdc service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Neutron deleted interface e7c40f5a-a642-4ee3-a06d-af2cf02db656; detaching it from the instance and deleting it from the info cache
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-0fc9ecd1-54b1-4491-9a7e-f6e3171fcc8d req-bb445d9a-f711-4716-93a1-eb568aeb4fdc service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-0fc9ecd1-54b1-4491-9a7e-f6e3171fcc8d req-bb445d9a-f711-4716-93a1-eb568aeb4fdc service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Detach interface failed, port_id=e7c40f5a-a642-4ee3-a06d-af2cf02db656, reason: Instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518 could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:03:09 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Deleted allocations for instance b5d94cfe-1100-4fbc-9ca9-78a94d5fc518
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-be9bd2b6-8de9-4446-8c7a-f28e7b0b259e tempest-TestServerVolumeAttachmentScenario-38513420 tempest-TestServerVolumeAttachmentScenario-38513420-project-member] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:10 user nova-compute[75463]: WARNING nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state deleted and task_state None.
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:10 user nova-compute[75463]: WARNING nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state deleted and task_state None.
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:10 user nova-compute[75463]: WARNING nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state deleted and task_state None.
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:10 user nova-compute[75463]: WARNING nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-unplugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state deleted and task_state None.
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Acquiring lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] Lock "b5d94cfe-1100-4fbc-9ca9-78a94d5fc518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] No waiting events found dispatching network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:10 user nova-compute[75463]: WARNING nova.compute.manager [req-fc7c23ab-66cc-449c-bf10-6bb699b8d7be req-6c361cac-f721-4b17-9175-8ce404bd9d8b service nova] [instance: b5d94cfe-1100-4fbc-9ca9-78a94d5fc518] Received unexpected event network-vif-plugged-e7c40f5a-a642-4ee3-a06d-af2cf02db656 for instance with vm_state deleted and task_state None.
Nov 03 18:03:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:11 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:03:14 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Creating image(s)
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Ensure instance console log exists: /opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start _get_guest_xml network_info=[{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e18c7168-05a6-43fb-b07f-465ad3438159', 'attached_at': '', 'detached_at': '', 'volume_id': '47d88802-fa88-4c46-9ac2-3dfe8744669a', 'serial': '47d88802-fa88-4c46-9ac2-3dfe8744669a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'c189ca56-0811-48cb-8fb7-47e8a23ec1d7', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:03:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:14 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:03:14 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:03:14 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:03:14 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5034ec-f467-4bf6-bc3d-3bce4c3119a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:03:14 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[476369da-2017-42a8-baf1-7223297f87bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a] added
Nov 03 18:03:14 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62447468-1f5f-430c-8bf8-9e38c69e48dc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec27e275-d8cb-41dc-9d3e-97afa49b322f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:14 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxspVaRi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxspVaRi" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7da1f3-1227-4662-9d5b-0d32f90654b3]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxspVaRi'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3213246-203a-4d36-872e-da56a900f083]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0441f04-5902-4dcb-a69d-e4c0fd45040a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0befc0-0e8e-49fe-84d5-4cdf73ce93d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]
Nov 03 18:03:15 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.
Nov 03 18:03:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebad0c5-f550-48e0-a7cc-c75ea8943365]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fffb7-ce9f-45be-9ef1-49ac9ddc5aa1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:15 user nova-compute[75463]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:03:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:15 user nova-compute[75463]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:03:15 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a081c3-b01f-4ba1-bdb2-1e91eee55969]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:03:15 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26562393133343464', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393133343464', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.objects.instance [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'pci_devices' on Instance uuid e18c7168-05a6-43fb-b07f-465ad3438159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:03:16 user nova-compute[75463]:   <uuid>e18c7168-05a6-43fb-b07f-465ad3438159</uuid>
Nov 03 18:03:16 user nova-compute[75463]:   <name>instance-00000030</name>
Nov 03 18:03:16 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:03:16 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:03:16 user nova-compute[75463]:   <metadata>
Nov 03 18:03:16 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:03:16 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:03:16 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherA-server-493316920</nova:name>
Nov 03 18:03:16 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:03:14</nova:creationTime>
Nov 03 18:03:16 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:03:16 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:03:16 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:03:16 user nova-compute[75463]:       <nova:owner>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:user uuid="439941527e584c22a684399b2b30a6d1">tempest-ServerActionsTestOtherA-1993044933-project-member</nova:user>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:project uuid="1310c11a9e2a4e17851e9f0367b6adc9">tempest-ServerActionsTestOtherA-1993044933</nova:project>
Nov 03 18:03:16 user nova-compute[75463]:       </nova:owner>
Nov 03 18:03:16 user nova-compute[75463]:       <nova:ports>
Nov 03 18:03:16 user nova-compute[75463]:         <nova:port uuid="eb70b080-f097-4e9c-a275-a6d9812f8d12">
Nov 03 18:03:16 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 18:03:16 user nova-compute[75463]:         </nova:port>
Nov 03 18:03:16 user nova-compute[75463]:       </nova:ports>
Nov 03 18:03:16 user nova-compute[75463]:     </nova:instance>
Nov 03 18:03:16 user nova-compute[75463]:   </metadata>
Nov 03 18:03:16 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:03:16 user nova-compute[75463]:     <system>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="serial">e18c7168-05a6-43fb-b07f-465ad3438159</entry>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="uuid">e18c7168-05a6-43fb-b07f-465ad3438159</entry>
Nov 03 18:03:16 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:03:16 user nova-compute[75463]:     </system>
Nov 03 18:03:16 user nova-compute[75463]:   </sysinfo>
Nov 03 18:03:16 user nova-compute[75463]:   <os>
Nov 03 18:03:16 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:03:16 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:03:16 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:03:16 user nova-compute[75463]:   </os>
Nov 03 18:03:16 user nova-compute[75463]:   <features>
Nov 03 18:03:16 user nova-compute[75463]:     <acpi/>
Nov 03 18:03:16 user nova-compute[75463]:     <apic/>
Nov 03 18:03:16 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:03:16 user nova-compute[75463]:   </features>
Nov 03 18:03:16 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:03:16 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:03:16 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:03:16 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:03:16 user nova-compute[75463]:   </clock>
Nov 03 18:03:16 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:03:16 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:03:16 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:03:16 user nova-compute[75463]:   </cpu>
Nov 03 18:03:16 user nova-compute[75463]:   <devices>
Nov 03 18:03:16 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 18:03:16 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:03:16 user nova-compute[75463]:       <source dev="/dev/sdc"/>
Nov 03 18:03:16 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:03:16 user nova-compute[75463]:       <serial>47d88802-fa88-4c46-9ac2-3dfe8744669a</serial>
Nov 03 18:03:16 user nova-compute[75463]:     </disk>
Nov 03 18:03:16 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:03:16 user nova-compute[75463]:       <mac address="fa:16:3e:43:6d:94"/>
Nov 03 18:03:16 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:03:16 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:03:16 user nova-compute[75463]:       <target dev="tapeb70b080-f0"/>
Nov 03 18:03:16 user nova-compute[75463]:     </interface>
Nov 03 18:03:16 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:03:16 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159/console.log" append="off"/>
Nov 03 18:03:16 user nova-compute[75463]:     </serial>
Nov 03 18:03:16 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:03:16 user nova-compute[75463]:     <video>
Nov 03 18:03:16 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:03:16 user nova-compute[75463]:     </video>
Nov 03 18:03:16 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:03:16 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:03:16 user nova-compute[75463]:     </rng>
Nov 03 18:03:16 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:03:16 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:03:16 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:03:16 user nova-compute[75463]:     </memballoon>
Nov 03 18:03:16 user nova-compute[75463]:   </devices>
Nov 03 18:03:16 user nova-compute[75463]: </domain>
Nov 03 18:03:16 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG os_vif [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35541a68-9852-51e8-bc97-85798e9aa2a5', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb70b080-f0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb70b080-f0, col_values=(('qos', UUID('39accbdc-e8de-4828-8bb7-79aad07b1db8')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb70b080-f0, col_values=(('external_ids', {'iface-id': 'eb70b080-f097-4e9c-a275-a6d9812f8d12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:6d:94', 'vm-uuid': 'e18c7168-05a6-43fb-b07f-465ad3438159'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:16 user nova-compute[75463]: INFO os_vif [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0')
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:03:16 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No VIF found with MAC fa:16:3e:43:6d:94, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG nova.compute.manager [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:17 user nova-compute[75463]: WARNING nova.compute.manager [req-76bd3b0e-0ece-4ec1-8540-a96f72f8b198 req-699499b5-da5d-45b9-95d3-c6636676ffd8 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state building and task_state spawning.
Nov 03 18:03:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:03:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance spawned successfully.
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:19 user nova-compute[75463]: INFO nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:03:19 user nova-compute[75463]: INFO nova.compute.manager [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Took 27.51 seconds to build instance.
Nov 03 18:03:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-0c90b6ba-0877-4a10-9fef-58ba3d88cfda tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.613s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:19 user nova-compute[75463]: DEBUG nova.compute.manager [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:19 user nova-compute[75463]: WARNING nova.compute.manager [req-fb36cab3-6324-49b3-876c-1a026d3f08ff req-0dc6e494-db33-4872-9747-fdd33b38229e service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state None.
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:21 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.057079315185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 621790aa-0d18-490b-adad-cef419c35f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:03:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:03:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.compute.manager [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing instance network info cache due to event network-changed-c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] Acquiring lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] Acquired lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Refreshing network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:44 user nova-compute[75463]: INFO nova.compute.manager [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Terminating instance
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updated VIF entry in instance network info cache for port c66d6908-761b-4ecc-aa87-23d1909c84ed. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [{"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-883f7ac2-b1bd-4f65-9d14-7b4cce94d3dd req-4c090a87-d45b-46a1-814f-2a92ca74064a service nova] Releasing lock "refresh_cache-621790aa-0d18-490b-adad-cef419c35f03" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Instance destroyed successfully.
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.objects.instance [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lazy-loading 'resources' on Instance uuid 621790aa-0d18-490b-adad-cef419c35f03 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-03T17:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1637033815',display_name='tempest-TestShelveInstance-server-1637033815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1637033815',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELnWajfeVRbZmigM8Sq4xp+wKA+KQC0Ob9vkMCHshvuMHn8fmh/T5V2KVsBPknY2D6v0JKaa2xfty+dFwA8fj1e6HdXLyOQ3AjEhrT79r6NkfIHvYdzdG5w5Rm/64nDFw==',key_name='tempest-TestShelveInstance-1297893612',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='692ebed50cd34a6abcb2ec108bd28669',ramdisk_id='',reservation_id='r-a1xnm9cu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1649968938',owner_user_name='tempest-TestShelveInstance-1649968938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:02:22Z,user_data=None,user_id='f1b71d43c9e84a738a81e56daf4a14d6',uuid=621790aa-0d18-490b-adad-cef419c35f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converting VIF {"id": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "address": "fa:16:3e:ac:6a:9d", "network": {"id": "8b0e386e-cc0e-41fa-8804-5070c56a570a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1065228168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692ebed50cd34a6abcb2ec108bd28669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d6908-76", "ovs_interfaceid": "c66d6908-761b-4ecc-aa87-23d1909c84ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_vif [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66d6908-76, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbb53148-6e06-4f0e-a47c-19fb12dc9e43) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:44 user nova-compute[75463]: INFO os_vif [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:6a:9d,bridge_name='br-int',has_traffic_filtering=True,id=c66d6908-761b-4ecc-aa87-23d1909c84ed,network=Network(8b0e386e-cc0e-41fa-8804-5070c56a570a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d6908-76')
Nov 03 18:03:44 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXhwUdKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:03:44 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a017f87-b63c-4f5b-bab0-85563816037f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:03:44 user nova-compute[75463]: No targets found.
Nov 03 18:03:44 user nova-compute[75463]: iSNS:
Nov 03 18:03:44 user nova-compute[75463]: No targets found.
Nov 03 18:03:44 user nova-compute[75463]: STATIC:
Nov 03 18:03:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40
Nov 03 18:03:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:03:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:03:44 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a
Nov 03 18:03:44 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:03:44 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:03:44 user nova-compute[75463]: FIRMWARE:
Nov 03 18:03:44 user nova-compute[75463]: No targets found.
Nov 03 18:03:44 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:03:44 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:03:44 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d79836-70b0-4aab-a52a-6dbe55e20090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:44 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb456e4-0424-41fa-82fd-afb1ce5dd626]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:45 user nova-compute[75463]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:03:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 (non-flash)
Nov 03 18:03:45 user nova-compute[75463]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:03:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec59ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89e2dcb-be84-4054-a88e-abeb8544bc00]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ccc8d4-f5cc-47fb-b3b9-125db8302637]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[05135c39-2f2e-419c-a7ec-c2117b6010ec]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e26e8b-43be-4f8b-8d6e-a8fc7971ccbd]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4ad70076-9b2bb6aa7933f3fa', '/dev/disk/by-id/scsi-23962326262366161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ad70076') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebf7f89-dc4b-40d7-9c2b-fb73416469ba]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4be82-766d-4b5c-9a02-d994de022e4c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43560fd7-3aad-4b94-9df7-8a9dc471f302]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260]
Nov 03 18:03:45 user nova-compute[75463]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40, portal: 172.16.0.220,3260] successful.
Nov 03 18:03:45 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae002ae6-2260-40e2-ab44-c08b22e51e40 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b55c4ff-b3bc-46ad-af85-66de320aef87]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] <== disconnect_volume: return (294ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:03:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deleting instance files /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03_del
Nov 03 18:03:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deletion of /opt/stack/data/nova/instances/621790aa-0d18-490b-adad-cef419c35f03_del complete
Nov 03 18:03:45 user nova-compute[75463]: INFO nova.compute.manager [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 03 18:03:45 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:03:45 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:45 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Took 0.66 seconds to deallocate network for instance.
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-unplugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Acquiring lock "621790aa-0d18-490b-adad-cef419c35f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] Lock "621790aa-0d18-490b-adad-cef419c35f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] No waiting events found dispatching network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:46 user nova-compute[75463]: WARNING nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received unexpected event network-vif-plugged-c66d6908-761b-4ecc-aa87-23d1909c84ed for instance with vm_state active and task_state deleting.
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-0edf5aa3-2709-44cb-a493-4a43095e549c req-8b871ddb-be09-43c4-95f4-d776134921ad service nova] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Received event network-vif-deleted-c66d6908-761b-4ecc-aa87-23d1909c84ed {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:46 user nova-compute[75463]: INFO nova.compute.manager [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Took 0.85 seconds to detach 1 volumes for instance.
Nov 03 18:03:46 user nova-compute[75463]: DEBUG nova.compute.manager [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] [instance: 621790aa-0d18-490b-adad-cef419c35f03] Deleting volume: ae002ae6-2260-40e2-ab44-c08b22e51e40 {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:47 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:03:47 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:03:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:47 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Deleted allocations for instance 621790aa-0d18-490b-adad-cef419c35f03
Nov 03 18:03:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-cfcc24f6-2474-47e2-9040-97eb2d279a73 tempest-TestShelveInstance-1649968938 tempest-TestShelveInstance-1649968938-project-member] Lock "621790aa-0d18-490b-adad-cef419c35f03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:49 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:03:52 user nova-compute[75463]: INFO nova.compute.claims [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Claim successful on node user
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 18:03:52 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.policy [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faa80d6b17442a78b609734e886ab13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b6da9208ff44ef8b898e4f0023724a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:03:52 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Creating image(s)
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "/opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "/opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.part --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:53 user nova-compute[75463]: DEBUG nova.virt.images [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] 2840a5ab-5ced-45ff-858f-cb5f16ae4f42 was qcow2, converting to raw {{(pid=75463) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 03 18:03:53 user nova-compute[75463]: DEBUG nova.privsep.utils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75463) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 03 18:03:53 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.part /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.converted {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.part /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.converted" returned: 0 in 0.611s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.converted --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Successfully created port: 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.617s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json" returned: 0 in 0.172s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc,backing_fmt=raw /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc,backing_fmt=raw /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk 1073741824" returned: 0 in 0.046s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "ade59d29f846edb2e5aa3d695d34b56ef8c791fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Successfully updated port: 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing instance network info cache due to event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:03:54 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Ensure instance console log exists: /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.neutron [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance network_info: |[{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Start _get_guest_xml network_info=[{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T18:03:49Z,direct_url=<?>,disk_format='qcow2',id=2840a5ab-5ced-45ff-858f-cb5f16ae4f42,min_disk=0,min_ram=0,name='tempest-scenario-img--265155977',owner='68b6da9208ff44ef8b898e4f0023724a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T18:03:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '2840a5ab-5ced-45ff-858f-cb5f16ae4f42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:03:55 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:55 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T18:03:49Z,direct_url=<?>,disk_format='qcow2',id=2840a5ab-5ced-45ff-858f-cb5f16ae4f42,min_disk=0,min_ram=0,name='tempest-scenario-img--265155977',owner='68b6da9208ff44ef8b898e4f0023724a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T18:03:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-403383401',display_name='tempest-TestMinimumBasicScenario-server-403383401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-403383401',id=49,image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkxyasR8A6Wm37AbGQkgIJ67kUF6noEwJd5rNww8CBLhCFdQXFkFjww1RT8TItU74+UeWdGXOw8KGBiPVfDYZXdGMDXbQIe3tsDJGbthhdoS7oLPTmMGeym7WgCLUp9/Q==',key_name='tempest-TestMinimumBasicScenario-1776388128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-fu600va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:03:53Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=b0a23675-84ba-4b81-9c5d-e185b6b257d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.objects.instance [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:03:55 user nova-compute[75463]:   <uuid>b0a23675-84ba-4b81-9c5d-e185b6b257d1</uuid>
Nov 03 18:03:55 user nova-compute[75463]:   <name>instance-00000031</name>
Nov 03 18:03:55 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:03:55 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:03:55 user nova-compute[75463]:   <metadata>
Nov 03 18:03:55 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:03:55 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:name>tempest-TestMinimumBasicScenario-server-403383401</nova:name>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:03:55</nova:creationTime>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:03:55 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:03:55 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:owner>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:user uuid="5faa80d6b17442a78b609734e886ab13">tempest-TestMinimumBasicScenario-988383719-project-member</nova:user>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:project uuid="68b6da9208ff44ef8b898e4f0023724a">tempest-TestMinimumBasicScenario-988383719</nova:project>
Nov 03 18:03:55 user nova-compute[75463]:       </nova:owner>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:root type="image" uuid="2840a5ab-5ced-45ff-858f-cb5f16ae4f42"/>
Nov 03 18:03:55 user nova-compute[75463]:       <nova:ports>
Nov 03 18:03:55 user nova-compute[75463]:         <nova:port uuid="21c6f3bf-2213-4fe7-a19d-e215187732dd">
Nov 03 18:03:55 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 03 18:03:55 user nova-compute[75463]:         </nova:port>
Nov 03 18:03:55 user nova-compute[75463]:       </nova:ports>
Nov 03 18:03:55 user nova-compute[75463]:     </nova:instance>
Nov 03 18:03:55 user nova-compute[75463]:   </metadata>
Nov 03 18:03:55 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:03:55 user nova-compute[75463]:     <system>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="serial">b0a23675-84ba-4b81-9c5d-e185b6b257d1</entry>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="uuid">b0a23675-84ba-4b81-9c5d-e185b6b257d1</entry>
Nov 03 18:03:55 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:03:55 user nova-compute[75463]:     </system>
Nov 03 18:03:55 user nova-compute[75463]:   </sysinfo>
Nov 03 18:03:55 user nova-compute[75463]:   <os>
Nov 03 18:03:55 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:03:55 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:03:55 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:03:55 user nova-compute[75463]:   </os>
Nov 03 18:03:55 user nova-compute[75463]:   <features>
Nov 03 18:03:55 user nova-compute[75463]:     <acpi/>
Nov 03 18:03:55 user nova-compute[75463]:     <apic/>
Nov 03 18:03:55 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:03:55 user nova-compute[75463]:   </features>
Nov 03 18:03:55 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:03:55 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:03:55 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:03:55 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:03:55 user nova-compute[75463]:   </clock>
Nov 03 18:03:55 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:03:55 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:03:55 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:03:55 user nova-compute[75463]:   </cpu>
Nov 03 18:03:55 user nova-compute[75463]:   <devices>
Nov 03 18:03:55 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 18:03:55 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 18:03:55 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk"/>
Nov 03 18:03:55 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:03:55 user nova-compute[75463]:     </disk>
Nov 03 18:03:55 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:03:55 user nova-compute[75463]:       <mac address="fa:16:3e:ea:48:f0"/>
Nov 03 18:03:55 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:03:55 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:03:55 user nova-compute[75463]:       <target dev="tap21c6f3bf-22"/>
Nov 03 18:03:55 user nova-compute[75463]:     </interface>
Nov 03 18:03:55 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:03:55 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/console.log" append="off"/>
Nov 03 18:03:55 user nova-compute[75463]:     </serial>
Nov 03 18:03:55 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:03:55 user nova-compute[75463]:     <video>
Nov 03 18:03:55 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:03:55 user nova-compute[75463]:     </video>
Nov 03 18:03:55 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:03:55 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:03:55 user nova-compute[75463]:     </rng>
Nov 03 18:03:55 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:03:55 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:03:55 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:03:55 user nova-compute[75463]:     </memballoon>
Nov 03 18:03:55 user nova-compute[75463]:   </devices>
Nov 03 18:03:55 user nova-compute[75463]: </domain>
Nov 03 18:03:55 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-403383401',display_name='tempest-TestMinimumBasicScenario-server-403383401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-403383401',id=49,image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkxyasR8A6Wm37AbGQkgIJ67kUF6noEwJd5rNww8CBLhCFdQXFkFjww1RT8TItU74+UeWdGXOw8KGBiPVfDYZXdGMDXbQIe3tsDJGbthhdoS7oLPTmMGeym7WgCLUp9/Q==',key_name='tempest-TestMinimumBasicScenario-1776388128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-fu600va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:03:53Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=b0a23675-84ba-4b81-9c5d-e185b6b257d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG os_vif [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5607899-4091-5a1a-bd85-9cfbbf60e861', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21c6f3bf-22, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21c6f3bf-22, col_values=(('qos', UUID('7b08e221-67e6-47df-a473-984b7b52f880')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21c6f3bf-22, col_values=(('external_ids', {'iface-id': '21c6f3bf-2213-4fe7-a19d-e215187732dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:48:f0', 'vm-uuid': 'b0a23675-84ba-4b81-9c5d-e185b6b257d1'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:55 user nova-compute[75463]: INFO os_vif [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22')
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No VIF found with MAC fa:16:3e:ea:48:f0, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated VIF entry in instance network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG nova.network.neutron [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:03:55 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-71ab0867-3989-4d3c-b4bc-cc2d24edb208 req-505381da-fe9e-4d25-84e4-5867b5620e9b service nova] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:56 user nova-compute[75463]: DEBUG nova.compute.manager [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:56 user nova-compute[75463]: WARNING nova.compute.manager [req-ca3328d5-1e23-42c8-8bba-98bc55887cdc req-baef087f-fda5-4dfe-9d98-33cae346d30c service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state building and task_state spawning.
Nov 03 18:03:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:03:58 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance spawned successfully.
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:03:58 user nova-compute[75463]: INFO nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:03:58 user nova-compute[75463]: DEBUG nova.compute.manager [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:03:58 user nova-compute[75463]: WARNING nova.compute.manager [req-e02ec5b3-03b6-4f10-9051-afebdf438a1f req-f5660b8b-5e56-4cc9-8b70-102cb1a4d69f service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state building and task_state spawning.
Nov 03 18:03:58 user nova-compute[75463]: INFO nova.compute.manager [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Took 6.83 seconds to build instance.
Nov 03 18:03:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-71cb3ab1-d7cf-4b24-854b-7db482578a47 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.923s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:04:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:04:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:04:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:04:22 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=25.00722885131836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:04:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Verify base images {{(pid=75463) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Image id 2840a5ab-5ced-45ff-858f-cb5f16ae4f42 yields fingerprint ade59d29f846edb2e5aa3d695d34b56ef8c791fc {{(pid=75463) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 18:04:40 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] image 2840a5ab-5ced-45ff-858f-cb5f16ae4f42 at (/opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc): checking
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] image 2840a5ab-5ced-45ff-858f-cb5f16ae4f42 at (/opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc): image is in use {{(pid=75463) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75463) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Image id cf8a3394-bcc6-4ef0-a69c-469776200bf6 yields fingerprint b95efc509cb48c020b1cc67b50ab80dbd931ef2f {{(pid=75463) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 03 18:04:40 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] image cf8a3394-bcc6-4ef0-a69c-469776200bf6 at (/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f): checking
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] image cf8a3394-bcc6-4ef0-a69c-469776200bf6 at (/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f): image is in use {{(pid=75463) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] 0c5057dc-628c-4c02-bc41-27473e7bc516 is a valid instance name {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] 0c5057dc-628c-4c02-bc41-27473e7bc516 has a disk file {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 is backed by b95efc509cb48c020b1cc67b50ab80dbd931ef2f {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] e18c7168-05a6-43fb-b07f-465ad3438159 is a valid instance name {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] b0a23675-84ba-4b81-9c5d-e185b6b257d1 is a valid instance name {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] b0a23675-84ba-4b81-9c5d-e185b6b257d1 has a disk file {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 03 18:04:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 is backed by ade59d29f846edb2e5aa3d695d34b56ef8c791fc {{(pid=75463) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27
Nov 03 18:04:41 user nova-compute[75463]: WARNING nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Active base files: /opt/stack/data/nova/instances/_base/ade59d29f846edb2e5aa3d695d34b56ef8c791fc /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Removable base files: /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44 /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7 /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33 /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27 /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/33b70335dbe96f7a4d59f21c09679c3fd4e81b44
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db6fb85642bd6deec40cba28f4f4971de74f01e7
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d19641f8e4a7fabaa569d5adf3eaad06f8efc33
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eaefb58950912fcb2c9764088ae3967db2c2d78b
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad3e3762623d1133be4e5cf92da1e0fde63f7a27
Nov 03 18:04:41 user nova-compute[75463]: INFO nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3ca29a958088bb8be984249a0389d07a6b149c3
Nov 03 18:04:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Verification complete {{(pid=75463) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 03 18:04:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Verify swap images {{(pid=75463) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 03 18:04:41 user nova-compute[75463]: DEBUG nova.virt.libvirt.imagecache [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Verify ephemeral images {{(pid=75463) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 03 18:04:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:04:43 user nova-compute[75463]: DEBUG nova.compute.manager [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing instance network info cache due to event network-changed-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:04:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:04:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:04:43 user nova-compute[75463]: DEBUG nova.network.neutron [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Refreshing network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated VIF entry in instance network info cache for port 1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG nova.network.neutron [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-f8a9288e-b782-437d-92ff-dba2ab3a952e req-c3bb4beb-37c2-459b-8761-4f2ae790afe0 service nova] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Stashing vm_state: active {{(pid=75463) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:44 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:04:44 user nova-compute[75463]: INFO nova.compute.claims [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Claim successful on node user
Nov 03 18:04:44 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating resource usage from migration 3924148e-256d-4d3d-bb7e-8038e40f9005
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.251s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:45 user nova-compute[75463]: INFO nova.compute.manager [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Migrating
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-changed-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.compute.manager [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Refreshing instance network info cache due to event network-changed-eb70b080-f097-4e9c-a275-a6d9812f8d12. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.network.neutron [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Refreshing network info cache for port eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Starting migrate_disk_and_power_off {{(pid=75463) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.compute.manager [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:04:46 user nova-compute[75463]: WARNING nova.compute.manager [req-17b4004e-6cc3-45fc-8dee-05fec531e6ad req-6ddb65a2-cb28-41a1-8099-f4f129f5599a service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state resize_migrating.
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.network.neutron [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updated VIF entry in instance network info cache for port eb70b080-f097-4e9c-a275-a6d9812f8d12. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.network.neutron [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1f868785-9528-437a-b3bb-ca089616e2c3 req-5c6ca894-bc4f-4efb-b805-fe23421674bb service nova] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance destroyed successfully.
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:03:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb70b080-f0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39accbdc-e8de-4828-8bb7-79aad07b1db8) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:46 user nova-compute[75463]: INFO os_vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0')
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:04:46 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[69341cd0-5609-432b-ac15-19f2d967349f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:04:46 user nova-compute[75463]: No targets found.
Nov 03 18:04:46 user nova-compute[75463]: iSNS:
Nov 03 18:04:46 user nova-compute[75463]: No targets found.
Nov 03 18:04:46 user nova-compute[75463]: STATIC:
Nov 03 18:04:46 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a
Nov 03 18:04:46 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:04:46 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:04:46 user nova-compute[75463]: FIRMWARE:
Nov 03 18:04:46 user nova-compute[75463]: No targets found.
Nov 03 18:04:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:04:46 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:04:46 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c1081-cd94-45ec-a316-182505119714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ad8ef-1506-4e3f-95a0-db1a36194642]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:04:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:04:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec5870a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[38775049-04f5-4a57-9a44-2939d4b2ca77]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1b1eb-f7db-4a4a-b6d6-7be89a905405]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b906e2-05a8-4821-8265-b183f95166a4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319a7ae-84f3-4b87-b86c-9bff85846fea]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26562393133343464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6970d9d2', '/dev/disk/by-id/scsi-1SCST_BIO6970d9d2-eb91344d2710efda') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecdd977-c801-4e4a-8190-9e8aade9daec]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c756d54-d5c2-45a8-93a0-e9b760b6980c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d35a450-ae80-445f-a03a-bb3caf43a55a]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]
Nov 03 18:04:46 user nova-compute[75463]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.
Nov 03 18:04:46 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea0c13f-ca9c-4d1e-ab52-d38adbd3b7ed]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== disconnect_volume: return (290ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:04:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Port eb70b080-f097-4e9c-a275-a6d9812f8d12 binding to destination host user is already ACTIVE {{(pid=75463) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:04:47 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG nova.compute.manager [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:04:48 user nova-compute[75463]: WARNING nova.compute.manager [req-20f14d91-5f12-4ce5-ad37-a12bdd19624d req-1a50e960-14d3-4b2c-853c-2b116aeadbe4 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state resize_migrated.
Nov 03 18:04:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.utils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce299a-4f52-4ba2-be7c-d411ab8b7ac2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073a7df-179b-4a59-9da0-20a90304e03c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f41e224-1acb-4a42-828f-e2c7841a6d66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb6641b-c696-4b10-95b8-efbd982a08f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:04:48 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:04:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f50d3-7152-4e05-a36c-039115bb4d5a]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:04:48 user nova-compute[75463]: DEBUG os_brick.utils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:04:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:04:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Starting finish_migration {{(pid=75463) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance directory exists: not creating {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 03 18:05:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Creating image(s)
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Did not create local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Ensure instance console log exists: /opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start _get_guest_xml network_info=[{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e18c7168-05a6-43fb-b07f-465ad3438159', 'attached_at': '2023-11-03T18:05:09.000000', 'detached_at': '', 'volume_id': '47d88802-fa88-4c46-9ac2-3dfe8744669a', 'serial': '47d88802-fa88-4c46-9ac2-3dfe8744669a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'dc806c51-0e52-4c50-a2de-5e9d6d09e569', 'volume_type': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:05:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:05:08 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:05:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:05:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:05:08 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[44304a02-2c02-44a9-b5e1-19d15775ec3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:05:08 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaaff68-8f13-4b8e-ba2e-8133a0851e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a] added
Nov 03 18:05:08 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1536d-6bfc-47e1-a499-eaa34af0deb9]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a7539-7f30-4cbf-ace4-ee9b5e3c8a67]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxspVaRi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxspVaRi" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb666fe-1364-4d61-98ad-c4a3cdedefcd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxspVaRi'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[384acecc-d1b5-46c8-a015-e5cc1d469f03]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f03f95-f8d2-4353-b448-96b88a6b0738]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:05:09 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:05:09 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:05:09 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 18:05:09 user nova-compute[75463]: 
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e15d2-535c-4eb4-9e1e-048fa5f9e4f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]
Nov 03 18:05:09 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.
Nov 03 18:05:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c79b3-ccb1-4561-ae6a-6e937b3f5f96]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b57197-589c-4f8f-bcab-05728d5ee9c7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:05:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:05:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ae83b4-8f46-4147-8fba-e71482ff7dc9]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:05:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26562393133343464', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393133343464', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:03:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:05:10 user nova-compute[75463]:   <uuid>e18c7168-05a6-43fb-b07f-465ad3438159</uuid>
Nov 03 18:05:10 user nova-compute[75463]:   <name>instance-00000030</name>
Nov 03 18:05:10 user nova-compute[75463]:   <memory>2097152</memory>
Nov 03 18:05:10 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:05:10 user nova-compute[75463]:   <metadata>
Nov 03 18:05:10 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:05:10 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:05:10 user nova-compute[75463]:       <nova:name>tempest-ServerActionsTestOtherA-server-493316920</nova:name>
Nov 03 18:05:10 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:05:08</nova:creationTime>
Nov 03 18:05:10 user nova-compute[75463]:       <nova:flavor name="m1.small">
Nov 03 18:05:10 user nova-compute[75463]:         <nova:memory>2048</nova:memory>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:disk>20</nova:disk>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:05:10 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:05:10 user nova-compute[75463]:       <nova:owner>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:user uuid="439941527e584c22a684399b2b30a6d1">tempest-ServerActionsTestOtherA-1993044933-project-member</nova:user>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:project uuid="1310c11a9e2a4e17851e9f0367b6adc9">tempest-ServerActionsTestOtherA-1993044933</nova:project>
Nov 03 18:05:10 user nova-compute[75463]:       </nova:owner>
Nov 03 18:05:10 user nova-compute[75463]:       <nova:ports>
Nov 03 18:05:10 user nova-compute[75463]:         <nova:port uuid="eb70b080-f097-4e9c-a275-a6d9812f8d12">
Nov 03 18:05:10 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 18:05:10 user nova-compute[75463]:         </nova:port>
Nov 03 18:05:10 user nova-compute[75463]:       </nova:ports>
Nov 03 18:05:10 user nova-compute[75463]:     </nova:instance>
Nov 03 18:05:10 user nova-compute[75463]:   </metadata>
Nov 03 18:05:10 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:05:10 user nova-compute[75463]:     <system>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="serial">e18c7168-05a6-43fb-b07f-465ad3438159</entry>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="uuid">e18c7168-05a6-43fb-b07f-465ad3438159</entry>
Nov 03 18:05:10 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:05:10 user nova-compute[75463]:     </system>
Nov 03 18:05:10 user nova-compute[75463]:   </sysinfo>
Nov 03 18:05:10 user nova-compute[75463]:   <os>
Nov 03 18:05:10 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:05:10 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:05:10 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:05:10 user nova-compute[75463]:   </os>
Nov 03 18:05:10 user nova-compute[75463]:   <features>
Nov 03 18:05:10 user nova-compute[75463]:     <acpi/>
Nov 03 18:05:10 user nova-compute[75463]:     <apic/>
Nov 03 18:05:10 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:05:10 user nova-compute[75463]:   </features>
Nov 03 18:05:10 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:05:10 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:05:10 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:05:10 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:05:10 user nova-compute[75463]:   </clock>
Nov 03 18:05:10 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:05:10 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:05:10 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:05:10 user nova-compute[75463]:   </cpu>
Nov 03 18:05:10 user nova-compute[75463]:   <devices>
Nov 03 18:05:10 user nova-compute[75463]:     <disk type="block" device="disk">
Nov 03 18:05:10 user nova-compute[75463]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:05:10 user nova-compute[75463]:       <source dev="/dev/sdb"/>
Nov 03 18:05:10 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:05:10 user nova-compute[75463]:       <serial>47d88802-fa88-4c46-9ac2-3dfe8744669a</serial>
Nov 03 18:05:10 user nova-compute[75463]:     </disk>
Nov 03 18:05:10 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:05:10 user nova-compute[75463]:       <mac address="fa:16:3e:43:6d:94"/>
Nov 03 18:05:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:05:10 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:05:10 user nova-compute[75463]:       <target dev="tapeb70b080-f0"/>
Nov 03 18:05:10 user nova-compute[75463]:     </interface>
Nov 03 18:05:10 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:05:10 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159/console.log" append="off"/>
Nov 03 18:05:10 user nova-compute[75463]:     </serial>
Nov 03 18:05:10 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:05:10 user nova-compute[75463]:     <video>
Nov 03 18:05:10 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:05:10 user nova-compute[75463]:     </video>
Nov 03 18:05:10 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:05:10 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:05:10 user nova-compute[75463]:     </rng>
Nov 03 18:05:10 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:05:10 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:05:10 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:05:10 user nova-compute[75463]:     </memballoon>
Nov 03 18:05:10 user nova-compute[75463]:   </devices>
Nov 03 18:05:10 user nova-compute[75463]: </domain>
Nov 03 18:05:10 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:03:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-738629629-network", "vif_mac": "fa:16:3e:43:6d:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG os_vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35541a68-9852-51e8-bc97-85798e9aa2a5', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb70b080-f0, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb70b080-f0, col_values=(('qos', UUID('34cd42da-6579-4223-8076-4397ddc355d4')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb70b080-f0, col_values=(('external_ids', {'iface-id': 'eb70b080-f097-4e9c-a275-a6d9812f8d12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:6d:94', 'vm-uuid': 'e18c7168-05a6-43fb-b07f-465ad3438159'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:10 user nova-compute[75463]: INFO os_vif [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0')
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:05:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] No VIF found with MAC fa:16:3e:43:6d:94, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:05:11 user nova-compute[75463]: WARNING nova.compute.manager [req-674bab53-a7d4-40d4-b479-b8ea9aca1c9a req-a6b7a21c-7d63-4890-aa07-c086c003c898 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state resize_finish.
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:05:13 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance running successfully.
Nov 03 18:05:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Failed to set time: agent not configured {{(pid=75463) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f3fb3b44-07d6-471d-80d3-605dd9696190 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] finish_migration finished successfully. {{(pid=75463) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:05:13 user nova-compute[75463]: WARNING nova.compute.manager [req-051d8538-7136-4785-8a18-7b59a5c5b784 req-cc399d19-f564-40cc-9b16-b507be1e1936 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state resize_finish.
Nov 03 18:05:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:05:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:05:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:23 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:05:23 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:05:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=25.00308609008789GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Applying migration context for instance e18c7168-05a6-43fb-b07f-465ad3438159 as it has an incoming, in-progress migration 3924148e-256d-4d3d-bb7e-8038e40f9005. Migration status is finished {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 18:05:23 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating resource usage from migration 3924148e-256d-4d3d-bb7e-8038e40f9005
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Migration 3924148e-256d-4d3d-bb7e-8038e40f9005 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:05:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:05:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:05:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:05:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:05:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG nova.objects.instance [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:05:48 user nova-compute[75463]: INFO nova.compute.manager [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Attaching volume 2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 to /dev/vdb
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.utils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bddad87-accf-48fb-9247-671522bf350e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afdbca7-2629-46a2-be8f-db9cb764fc24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041936a-68d9-4615-ad91-9f047acd612a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3554c-2a46-4d29-9934-b5c67184cd7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:05:48 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:05:48 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c71c22-c105-46da-b94a-1451c1fde33c]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG os_brick.utils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:05:48 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating existing volume attachment record: eb743421-127f-477a-8251-caa0d3c1dbbe {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:05:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:06:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:03 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpDkRlYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:06:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:06:08 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:06:08 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:06:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af8c1b-da6c-4d6f-b79b-9ff2b5d6aa06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:06:08 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:08 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c087434d-e46c-412b-b781-cd36244e8b16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11] added
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5669e-d66a-4d20-9f06-7b9a1fa34af1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93603ed-3c0c-4a35-bea7-6c91bceb1e9e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpDkRlYB {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpDkRlYB" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[06188dce-1bf6-47da-8f93-ea7a579ea3ed]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FpDkRlYB'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46e9bfd-8b2c-48f2-beac-6ada25f55c8f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d5a0fc-831c-4833-b7ac-6797ef04e7fb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4650c-65c1-45c2-bb4b-c3cbf37bbaf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260]
Nov 03 18:06:09 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260] successful.
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023191d-ac8c-43fd-931a-59da8136aaa1]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f1dbe8-d1e9-4acb-ae49-0c640a4f749f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:06:09 user nova-compute[75463]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:06:09 user nova-compute[75463]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)
Nov 03 18:06:09 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba79fe-156c-4342-97fb-e421fd321add]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:06:09 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpDkRlYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23339656462356466', 'path': '/dev/sdc'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339656462356466', 'path': '/dev/sdc'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.objects.instance [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:06:10 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:06:10 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:06:10 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:06:10 user nova-compute[75463]:   <serial>2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11</serial>
Nov 03 18:06:10 user nova-compute[75463]: </disk>
Nov 03 18:06:10 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] No VIF found with MAC fa:16:3e:ea:48:f0, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:06:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-272dd0c6-0f06-47f3-8b0e-b96756629598 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.170s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing instance network info cache due to event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG nova.network.neutron [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG nova.network.neutron [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated VIF entry in instance network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG nova.network.neutron [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:06:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c9426d78-5719-4045-afae-0e967950caf1 req-707bd1e0-aa7c-4b64-9a8d-4aa7c0c82ac9 service nova] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:06:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG nova.compute.manager [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing instance network info cache due to event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated VIF entry in instance network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG nova.network.neutron [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e98b2a2e-ea25-4ae1-ac96-999d05850866 req-ceaf9435-d18e-440c-8fc4-e6b929681656 service nova] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:15 user nova-compute[75463]: INFO nova.compute.manager [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Rebooting instance
Nov 03 18:06:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:06:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:06:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:06:16 user nova-compute[75463]: DEBUG nova.network.neutron [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:06:16 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:06:16 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:06:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:17 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:06:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:06:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:06:17 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:18 user nova-compute[75463]: DEBUG nova.compute.manager [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:06:18 user nova-compute[75463]: WARNING nova.compute.manager [req-112a44ad-1094-4f06-9908-4129553da6eb req-242df5f1-1804-442d-82a5-1e7d38f4703e service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state active and task_state reboot_started.
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance shutdown successfully.
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG nova.compute.manager [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:06:21 user nova-compute[75463]: WARNING nova.compute.manager [req-5011bf6d-08ad-4db7-b03a-8b034c6bb0b3 req-99b2d7d8-0a70-4cd6-8090-3458f6325cec service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state active and task_state reboot_started.
Nov 03 18:06:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:06:22 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance running successfully.
Nov 03 18:06:22 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance soft rebooted successfully.
Nov 03 18:06:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:06:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-2e5b764d-f617-42c7-ab60-f7fceacf5a26 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.042s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:06:23 user nova-compute[75463]: WARNING nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state active and task_state None.
Nov 03 18:06:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:06:23 user nova-compute[75463]: WARNING nova.compute.manager [req-eea5b1d9-4ee9-46b6-8497-56f83435f3ac req-c8b2deac-7457-4afc-bca5-9262414c39e5 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state active and task_state None.
Nov 03 18:06:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:23 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:06:24 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:06:24 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:06:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=24.993206024169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:24 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Applying migration context for instance e18c7168-05a6-43fb-b07f-465ad3438159 as it has an incoming, in-progress migration 3924148e-256d-4d3d-bb7e-8038e40f9005. Migration status is finished {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 03 18:06:24 user nova-compute[75463]: INFO nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating resource usage from migration 3924148e-256d-4d3d-bb7e-8038e40f9005
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Migration 3924148e-256d-4d3d-bb7e-8038e40f9005 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid e18c7168-05a6-43fb-b07f-465ad3438159 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Going to confirm migration 2 {{(pid=75463) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:06:34 user nova-compute[75463]: DEBUG nova.objects.instance [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'info_cache' on Instance uuid e18c7168-05a6-43fb-b07f-465ad3438159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG nova.network.neutron [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'migration_context' on Instance uuid e18c7168-05a6-43fb-b07f-465ad3438159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG nova.objects.base [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Object Instance<e18c7168-05a6-43fb-b07f-465ad3438159> lazy-loaded attributes: info_cache,migration_context {{(pid=75463) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:06:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.302s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:35 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Deleted allocation for migration 3924148e-256d-4d3d-bb7e-8038e40f9005
Nov 03 18:06:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-dc585cb0-ca0e-4f25-85c0-dc4ab95fe3b8 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.230s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:06:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:06:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:04 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:19 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:07:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:07:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:07:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:07:25 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:07:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:07:26 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:07:26 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=24.992359161376953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:07:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:07:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:07:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:07:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:07:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing instance network info cache due to event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:08:07 user nova-compute[75463]: DEBUG nova.network.neutron [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated VIF entry in instance network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.network.neutron [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0ace96f8-487f-4fc9-aed9-658286f5afae req-9d12bb65-8290-4bdc-bb00-c3782cbbf978 service nova] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:08:08 user nova-compute[75463]: INFO nova.compute.manager [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Detaching volume 2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11
Nov 03 18:08:08 user nova-compute[75463]: INFO nova.virt.block_device [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Attempting to driver detach volume 2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 from mountpoint /dev/vdb
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Attempting to detach device vdb from instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:08:08 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:08:08 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:08:08 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:08:08 user nova-compute[75463]:   <serial>2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11</serial>
Nov 03 18:08:08 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:08:08 user nova-compute[75463]: </disk>
Nov 03 18:08:08 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:08:08 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully detached device vdb from instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 from the persistent domain config.
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:08:08 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:08:08 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:08:08 user nova-compute[75463]:   <source dev="/dev/sdc"/>
Nov 03 18:08:08 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:08:08 user nova-compute[75463]:   <serial>2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11</serial>
Nov 03 18:08:08 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:08:08 user nova-compute[75463]: </disk>
Nov 03 18:08:08 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG nova.compute.manager [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing instance network info cache due to event network-changed-21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] Acquiring lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] Acquired lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:08:09 user nova-compute[75463]: DEBUG nova.network.neutron [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Refreshing network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:08:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updated VIF entry in instance network info cache for port 21c6f3bf-2213-4fe7-a19d-e215187732dd. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:08:10 user nova-compute[75463]: DEBUG nova.network.neutron [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [{"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:08:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-19a6e001-8b07-42b6-aa52-57fee985e374 req-ea9f9c94-f544-4a14-ba4a-9026da26cf98 service nova] Releasing lock "refresh_cache-b0a23675-84ba-4b81-9c5d-e185b6b257d1" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:08:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:08:19 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [{"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-0c5057dc-628c-4c02-bc41-27473e7bc516" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:08:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:25 user nova-compute[75463]: INFO nova.compute.manager [None req-9d6b5e5b-2521-4219-887f-fe6c4f986531 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Get console output
Nov 03 18:08:25 user nova-compute[75463]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:28 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:08:28 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.991565704345703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:08:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:08:29 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 is timed out.
Nov 03 18:08:29 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully detached device vdb from instance b0a23675-84ba-4b81-9c5d-e185b6b257d1 from the live domain config.
Nov 03 18:08:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpDkRlYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:08:29 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf48417-7063-4064-beaa-c23117a98bee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:08:29 user nova-compute[75463]: No targets found.
Nov 03 18:08:29 user nova-compute[75463]: iSNS:
Nov 03 18:08:29 user nova-compute[75463]: No targets found.
Nov 03 18:08:29 user nova-compute[75463]: STATIC:
Nov 03 18:08:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a
Nov 03 18:08:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:08:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:08:29 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11
Nov 03 18:08:29 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:08:29 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:08:29 user nova-compute[75463]: FIRMWARE:
Nov 03 18:08:29 user nova-compute[75463]: No targets found.
Nov 03 18:08:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:08:29 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:08:29 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a077a-8d37-4942-82f0-0178e30d6c29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f80037-cbca-4b5d-8cd3-1ead9735035f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:08:29 user nova-compute[75463]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)
Nov 03 18:08:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:08:29 user nova-compute[75463]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 (non-flash)
Nov 03 18:08:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c58c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11'): ({'sdc'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Removing single pathed devices sdc {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c2749f-687b-4db5-a833-5bd52ecee196]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a8015-a456-40fc-aaf6-d17e1f326c1d]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Flushing IO for device /dev/sdc {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93b2f5-fb33-4323-9669-a895328b3edc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[506e6682-4294-43c1-91ef-d22c70153aea]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] SCSI volumes sdc have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446586a-3df6-4727-8a22-f5f4ac920e18]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b3496-fcd2-4acb-9e41-73ec8035607a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260]
Nov 03 18:08:29 user nova-compute[75463]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11, portal: 172.16.0.220,3260] successful.
Nov 03 18:08:29 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ed4f6e8-ea0d-4b6d-ad52-c08c0da73d11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce586f-7225-41ba-9e86-a3de52e29e76]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] <== disconnect_volume: return (289ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:08:29 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:08:30 user nova-compute[75463]: DEBUG nova.objects.instance [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'flavor' on Instance uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:08:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-955942a1-a3a6-4531-afe4-8d6b657d0e4a tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.750s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:08:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:08:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:40 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:45 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:50 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:08:55 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:09 user nova-compute[75463]: INFO nova.compute.manager [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Terminating instance
Nov 03 18:09:09 user nova-compute[75463]: DEBUG nova.compute.manager [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:09 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.compute.manager [req-8f3bde7c-4517-440a-a699-60a3bedb2700 req-80ee934c-833b-481a-a2cd-c6abcfa09397 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Instance destroyed successfully.
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.objects.instance [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lazy-loading 'resources' on Instance uuid b0a23675-84ba-4b81-9c5d-e185b6b257d1 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-403383401',display_name='tempest-TestMinimumBasicScenario-server-403383401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-403383401',id=49,image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkxyasR8A6Wm37AbGQkgIJ67kUF6noEwJd5rNww8CBLhCFdQXFkFjww1RT8TItU74+UeWdGXOw8KGBiPVfDYZXdGMDXbQIe3tsDJGbthhdoS7oLPTmMGeym7WgCLUp9/Q==',key_name='tempest-TestMinimumBasicScenario-1776388128',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:03:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b6da9208ff44ef8b898e4f0023724a',ramdisk_id='',reservation_id='r-fu600va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2840a5ab-5ced-45ff-858f-cb5f16ae4f42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-988383719',owner_user_name='tempest-TestMinimumBasicScenario-988383719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:06:23Z,user_data=None,user_id='5faa80d6b17442a78b609734e886ab13',uuid=b0a23675-84ba-4b81-9c5d-e185b6b257d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converting VIF {"id": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "address": "fa:16:3e:ea:48:f0", "network": {"id": "5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112526219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b6da9208ff44ef8b898e4f0023724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21c6f3bf-22", "ovs_interfaceid": "21c6f3bf-2213-4fe7-a19d-e215187732dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG os_vif [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21c6f3bf-22, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b08e221-67e6-47df-a473-984b7b52f880) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:10 user nova-compute[75463]: INFO os_vif [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=21c6f3bf-2213-4fe7-a19d-e215187732dd,network=Network(5ea80062-0c49-4fc7-a1b0-a5185dc4c7a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21c6f3bf-22')
Nov 03 18:09:10 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Deleting instance files /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1_del
Nov 03 18:09:10 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Deletion of /opt/stack/data/nova/instances/b0a23675-84ba-4b81-9c5d-e185b6b257d1_del complete
Nov 03 18:09:10 user nova-compute[75463]: INFO nova.compute.manager [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 18:09:10 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:09:10 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:09:11 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Took 0.69 seconds to deallocate network for instance.
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-f0ad5095-d5a9-4d3c-b3df-c5a1a0a62820 req-c955ca2d-bc98-4980-a953-bfc29998b3ad service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-deleted-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:09:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:11 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Deleted allocations for instance b0a23675-84ba-4b81-9c5d-e185b6b257d1
Nov 03 18:09:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-9a16a1ef-1686-4d04-9e86-733514c0bb71 tempest-TestMinimumBasicScenario-988383719 tempest-TestMinimumBasicScenario-988383719-project-member] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:12 user nova-compute[75463]: WARNING nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state deleted and task_state None.
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:12 user nova-compute[75463]: WARNING nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state deleted and task_state None.
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:12 user nova-compute[75463]: WARNING nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state deleted and task_state None.
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:12 user nova-compute[75463]: WARNING nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-unplugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state deleted and task_state None.
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Acquiring lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] Lock "b0a23675-84ba-4b81-9c5d-e185b6b257d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] No waiting events found dispatching network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:12 user nova-compute[75463]: WARNING nova.compute.manager [req-8eec1722-1ab2-44aa-b0c7-cc882658b893 req-a1f32c65-8a36-4e22-8655-5a93f3e7fda6 service nova] [instance: b0a23675-84ba-4b81-9c5d-e185b6b257d1] Received unexpected event network-vif-plugged-21c6f3bf-2213-4fe7-a19d-e215187732dd for instance with vm_state deleted and task_state None.
Nov 03 18:09:15 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:09:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:09:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:09:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:09:22 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [{"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:09:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-e18c7168-05a6-43fb-b07f-465ad3438159" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:09:22 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:09:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:26 user nova-compute[75463]: INFO nova.compute.manager [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Terminating instance
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.compute.manager [req-0d2962c1-1108-43e2-9568-a51d0461f68a req-183b5bd8-34d0-4ee7-babb-b98f3ca8a681 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-unplugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Instance destroyed successfully.
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'resources' on Instance uuid e18c7168-05a6-43fb-b07f-465ad3438159 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-493316920',display_name='tempest-ServerActionsTestOtherA-server-493316920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-493316920',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-zalh5kg4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=e18c7168-05a6-43fb-b07f-465ad3438159,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "address": "fa:16:3e:43:6d:94", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb70b080-f0", "ovs_interfaceid": "eb70b080-f097-4e9c-a275-a6d9812f8d12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG os_vif [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb70b080-f0, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34cd42da-6579-4223-8076-4397ddc355d4) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:26 user nova-compute[75463]: INFO os_vif [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:6d:94,bridge_name='br-int',has_traffic_filtering=True,id=eb70b080-f097-4e9c-a275-a6d9812f8d12,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb70b080-f0')
Nov 03 18:09:26 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxspVaRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:09:26 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:09:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:26 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621393c-9b0a-494b-899b-2a609535416b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:09:27 user nova-compute[75463]: No targets found.
Nov 03 18:09:27 user nova-compute[75463]: iSNS:
Nov 03 18:09:27 user nova-compute[75463]: No targets found.
Nov 03 18:09:27 user nova-compute[75463]: STATIC:
Nov 03 18:09:27 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a
Nov 03 18:09:27 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:09:27 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:09:27 user nova-compute[75463]: FIRMWARE:
Nov 03 18:09:27 user nova-compute[75463]: No targets found.
Nov 03 18:09:27 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:09:27 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:09:27 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[948b31f5-fec2-4940-8700-9e787ad5c1c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4395b-a3a4-45c0-acf9-2ce2980fb68c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:09:27 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a (non-flash)
Nov 03 18:09:27 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe00c4e45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74b3b1-83c3-471d-8372-dc44ba676e7e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[813f8dfc-ad94-4a56-b54a-9ef539703b91]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[90741578-701f-46f7-8bec-413e0bbc6360]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2c732-4eda-4ce9-8c2f-f74750556017]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26562393133343464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6970d9d2', '/dev/disk/by-id/scsi-1SCST_BIO6970d9d2-eb91344d2710efda') {{(pid=86919) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[356c73e2-25e6-4b91-ac5c-030386135dd2]: (4, None) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0420bf1-347d-42f7-a4ae-f58bfb4fcf20]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1249c58f-7ebb-4a9b-b495-f8c3c4128756]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260]
Nov 03 18:09:27 user nova-compute[75463]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a, portal: 172.16.0.220,3260] successful.
Nov 03 18:09:27 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47d88802-fa88-4c46-9ac2-3dfe8744669a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd84001-e8e0-42e7-ba74-94e54392e0cb]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] <== disconnect_volume: return (270ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:09:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Deleting instance files /opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159_del
Nov 03 18:09:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Deletion of /opt/stack/data/nova/instances/e18c7168-05a6-43fb-b07f-465ad3438159_del complete
Nov 03 18:09:27 user nova-compute[75463]: INFO nova.compute.manager [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:09:27 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:09:28 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Took 0.70 seconds to deallocate network for instance.
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:09:28 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:09:28 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.018558502197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] Acquiring lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] Lock "e18c7168-05a6-43fb-b07f-465ad3438159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] No waiting events found dispatching network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:09:28 user nova-compute[75463]: WARNING nova.compute.manager [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received unexpected event network-vif-plugged-eb70b080-f097-4e9c-a275-a6d9812f8d12 for instance with vm_state active and task_state deleting.
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.manager [req-e30ad8e4-5347-44e8-b483-f97817bebeba req-bcd7919f-85e4-41e8-86d6-0c52153822b1 service nova] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Received event network-vif-deleted-eb70b080-f097-4e9c-a275-a6d9812f8d12 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 0c5057dc-628c-4c02-bc41-27473e7bc516 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance e18c7168-05a6-43fb-b07f-465ad3438159 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:09:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:28 user nova-compute[75463]: INFO nova.compute.manager [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Took 0.93 seconds to detach 1 volumes for instance.
Nov 03 18:09:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: e18c7168-05a6-43fb-b07f-465ad3438159] Deleting volume: 47d88802-fa88-4c46-9ac2-3dfe8744669a {{(pid=75463) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 03 18:09:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:09:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:09:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:09:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:09:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:29 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Deleted allocations for instance e18c7168-05a6-43fb-b07f-465ad3438159
Nov 03 18:09:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-a19fe715-9366-4856-8d9d-90ebcbd3a599 tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "e18c7168-05a6-43fb-b07f-465ad3438159" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:09:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:09:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:09:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:09:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:00 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:23 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:10:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:10:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:10:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:27 user nova-compute[75463]: INFO nova.compute.manager [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Terminating instance
Nov 03 18:10:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-unplugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] No waiting events found dispatching network-vif-unplugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:10:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-c55193aa-5d5d-4f1d-8731-62eaaa9a83d4 req-c97e18c6-ae7d-44c4-acf9-fb6046054dcf service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-unplugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:10:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Instance destroyed successfully.
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.objects.instance [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lazy-loading 'resources' on Instance uuid 0c5057dc-628c-4c02-bc41-27473e7bc516 {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T17:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1745290583',display_name='tempest-ServerActionsTestOtherA-server-1745290583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1745290583',id=18,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgmVrDJcTBc6EiUH/9bFF96R4yd1SGyq7CF3rKpil+895k+y0i89s5VSwfx2OXb+WtCfA/DG6YrGfAfYKbeA+1h3b2oVFZ++d/67icGiq06yMkLcPu8EIz89YN2tmTmVw==',key_name='tempest-keypair-1681433443',keypairs=<?>,launch_index=0,launched_at=2023-11-03T17:35:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1310c11a9e2a4e17851e9f0367b6adc9',ramdisk_id='',reservation_id='r-v0bbys83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1993044933',owner_user_name='tempest-ServerActionsTestOtherA-1993044933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439941527e584c22a684399b2b30a6d1',uuid=0c5057dc-628c-4c02-bc41-27473e7bc516,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converting VIF {"id": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "address": "fa:16:3e:b1:ae:92", "network": {"id": "02538d82-8564-421a-8bb4-be92ed43f8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-738629629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1310c11a9e2a4e17851e9f0367b6adc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd0ec7b-2c", "ovs_interfaceid": "1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG os_vif [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fd0ec7b-2c, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15fa0fcb-7d6a-41bd-a090-ef0a166c0f35) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:28 user nova-compute[75463]: INFO os_vif [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ae:92,bridge_name='br-int',has_traffic_filtering=True,id=1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648,network=Network(02538d82-8564-421a-8bb4-be92ed43f8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd0ec7b-2c')
Nov 03 18:10:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Deleting instance files /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516_del
Nov 03 18:10:28 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Deletion of /opt/stack/data/nova/instances/0c5057dc-628c-4c02-bc41-27473e7bc516_del complete
Nov 03 18:10:28 user nova-compute[75463]: INFO nova.compute.manager [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 03 18:10:28 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:10:28 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:10:29 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Took 0.82 seconds to deallocate network for instance.
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.080s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:29 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:10:29 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Deleted allocations for instance 0c5057dc-628c-4c02-bc41-27473e7bc516
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] Acquiring lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] No waiting events found dispatching network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:10:30 user nova-compute[75463]: WARNING nova.compute.manager [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received unexpected event network-vif-plugged-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 for instance with vm_state deleted and task_state None.
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.manager [req-07584a0a-d277-43ec-b057-123e0f2b61c0 req-17f3855f-5125-4aab-833d-6e1f12105a36 service nova] [instance: 0c5057dc-628c-4c02-bc41-27473e7bc516] Received event network-vif-deleted-1fd0ec7b-2cf8-4f7e-a26a-f0df2e273648 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fe30866a-5463-4519-8724-912c39e3141d tempest-ServerActionsTestOtherA-1993044933 tempest-ServerActionsTestOtherA-1993044933-project-member] Lock "0c5057dc-628c-4c02-bc41-27473e7bc516" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:30 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:10:30 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=25.084381103515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:10:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:10:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:10:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:10:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:10:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:10:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:10:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:10:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:11:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:11:23 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:11:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:11:30 user nova-compute[75463]: INFO nova.compute.claims [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Claim successful on node user
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:30 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 18:11:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:31 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=25.08246612548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.policy [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbf83e69dd4345f38fde161d01102914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eba73b878984f9cb9091d14dd951936', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:11:31 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Creating image(s)
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "/opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "/opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "/opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.214s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.199s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk 1073741824" returned: 0 in 0.099s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:31 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.212s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Successfully created port: ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Cannot resize image /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Ensure instance console log exists: /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Successfully updated port: ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-changed-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.compute.manager [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Refreshing instance network info cache due to event network-changed-ec95b18e-6734-4e5f-9e83-979c81e8fcf1. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Instance network_info: |[{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.neutron [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Refreshing network info cache for port ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Start _get_guest_xml network_info=[{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:11:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-972134974',display_name='tempest-ServersNegativeTestJSON-server-972134974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-972134974',id=50,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-o60m5exi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:11:31Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=c55ea77f-b7b2-4389-9597-6b4062e861fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.objects.instance [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lazy-loading 'pci_devices' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:11:33 user nova-compute[75463]:   <uuid>c55ea77f-b7b2-4389-9597-6b4062e861fb</uuid>
Nov 03 18:11:33 user nova-compute[75463]:   <name>instance-00000032</name>
Nov 03 18:11:33 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:11:33 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:11:33 user nova-compute[75463]:   <metadata>
Nov 03 18:11:33 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:11:33 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:name>tempest-ServersNegativeTestJSON-server-972134974</nova:name>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:11:33</nova:creationTime>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:11:33 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:11:33 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:owner>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:user uuid="bbf83e69dd4345f38fde161d01102914">tempest-ServersNegativeTestJSON-1934338688-project-member</nova:user>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:project uuid="3eba73b878984f9cb9091d14dd951936">tempest-ServersNegativeTestJSON-1934338688</nova:project>
Nov 03 18:11:33 user nova-compute[75463]:       </nova:owner>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 18:11:33 user nova-compute[75463]:       <nova:ports>
Nov 03 18:11:33 user nova-compute[75463]:         <nova:port uuid="ec95b18e-6734-4e5f-9e83-979c81e8fcf1">
Nov 03 18:11:33 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 03 18:11:33 user nova-compute[75463]:         </nova:port>
Nov 03 18:11:33 user nova-compute[75463]:       </nova:ports>
Nov 03 18:11:33 user nova-compute[75463]:     </nova:instance>
Nov 03 18:11:33 user nova-compute[75463]:   </metadata>
Nov 03 18:11:33 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:11:33 user nova-compute[75463]:     <system>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="serial">c55ea77f-b7b2-4389-9597-6b4062e861fb</entry>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="uuid">c55ea77f-b7b2-4389-9597-6b4062e861fb</entry>
Nov 03 18:11:33 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:11:33 user nova-compute[75463]:     </system>
Nov 03 18:11:33 user nova-compute[75463]:   </sysinfo>
Nov 03 18:11:33 user nova-compute[75463]:   <os>
Nov 03 18:11:33 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:11:33 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:11:33 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:11:33 user nova-compute[75463]:   </os>
Nov 03 18:11:33 user nova-compute[75463]:   <features>
Nov 03 18:11:33 user nova-compute[75463]:     <acpi/>
Nov 03 18:11:33 user nova-compute[75463]:     <apic/>
Nov 03 18:11:33 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:11:33 user nova-compute[75463]:   </features>
Nov 03 18:11:33 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:11:33 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:11:33 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:11:33 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:11:33 user nova-compute[75463]:   </clock>
Nov 03 18:11:33 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:11:33 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:11:33 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:11:33 user nova-compute[75463]:   </cpu>
Nov 03 18:11:33 user nova-compute[75463]:   <devices>
Nov 03 18:11:33 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 18:11:33 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 18:11:33 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk"/>
Nov 03 18:11:33 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:11:33 user nova-compute[75463]:     </disk>
Nov 03 18:11:33 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:11:33 user nova-compute[75463]:       <mac address="fa:16:3e:a2:64:7d"/>
Nov 03 18:11:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:11:33 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:11:33 user nova-compute[75463]:       <target dev="tapec95b18e-67"/>
Nov 03 18:11:33 user nova-compute[75463]:     </interface>
Nov 03 18:11:33 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:11:33 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/console.log" append="off"/>
Nov 03 18:11:33 user nova-compute[75463]:     </serial>
Nov 03 18:11:33 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:11:33 user nova-compute[75463]:     <video>
Nov 03 18:11:33 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:11:33 user nova-compute[75463]:     </video>
Nov 03 18:11:33 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:11:33 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:11:33 user nova-compute[75463]:     </rng>
Nov 03 18:11:33 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:11:33 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:11:33 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:11:33 user nova-compute[75463]:     </memballoon>
Nov 03 18:11:33 user nova-compute[75463]:   </devices>
Nov 03 18:11:33 user nova-compute[75463]: </domain>
Nov 03 18:11:33 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-972134974',display_name='tempest-ServersNegativeTestJSON-server-972134974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-972134974',id=50,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-o60m5exi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:11:31Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=c55ea77f-b7b2-4389-9597-6b4062e861fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG os_vif [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46d77eac-da91-5569-aa51-c1605a463d94', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec95b18e-67, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec95b18e-67, col_values=(('qos', UUID('a1050790-2aea-4720-b93f-fce32241c563')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec95b18e-67, col_values=(('external_ids', {'iface-id': 'ec95b18e-6734-4e5f-9e83-979c81e8fcf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:64:7d', 'vm-uuid': 'c55ea77f-b7b2-4389-9597-6b4062e861fb'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:33 user nova-compute[75463]: INFO os_vif [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67')
Nov 03 18:11:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:11:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] No VIF found with MAC fa:16:3e:a2:64:7d, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:11:34 user nova-compute[75463]: DEBUG nova.network.neutron [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updated VIF entry in instance network info cache for port ec95b18e-6734-4e5f-9e83-979c81e8fcf1. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:11:34 user nova-compute[75463]: DEBUG nova.network.neutron [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:11:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-c02ab6cf-b6e7-4ae5-909f-cfa8423fb8ef req-eb4b22ff-22ef-4684-838e-7f9de2ea08eb service nova] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG nova.compute.manager [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] No waiting events found dispatching network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:11:35 user nova-compute[75463]: WARNING nova.compute.manager [req-70bc7103-f41a-4ada-bd8c-bf5432759083 req-85584c63-111a-489b-b627-41a8e5c381c5 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received unexpected event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 for instance with vm_state building and task_state spawning.
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:35 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:11:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Instance spawned successfully.
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:37 user nova-compute[75463]: INFO nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] No waiting events found dispatching network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:11:37 user nova-compute[75463]: WARNING nova.compute.manager [req-483a4c11-9715-43e2-9a66-93e804f2c458 req-8084c535-0c64-441d-a773-f008c26a165b service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received unexpected event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 for instance with vm_state building and task_state spawning.
Nov 03 18:11:37 user nova-compute[75463]: INFO nova.compute.manager [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Took 7.30 seconds to build instance.
Nov 03 18:11:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-172a156a-3587-4e2b-ab2f-7aa2eacc9b0a tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.398s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:11:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:44 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:11:48 user nova-compute[75463]: INFO nova.compute.claims [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Claim successful on node user
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 18:11:48 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 18:11:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:48 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.policy [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0473a8d67f6a4e3f956744f43e1c97b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93877720a16f4de29ec31812c0b70ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:11:49 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Creating image(s)
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "/opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "/opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "/opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk 1073741824" returned: 0 in 0.054s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Cannot resize image /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Ensure instance console log exists: /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Successfully created port: 9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Successfully updated port: 9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-changed-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.compute.manager [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Refreshing instance network info cache due to event network-changed-9883196c-fd1f-4268-ba67-2371e41f2e9b. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 18:11:50 user nova-compute[75463]: DEBUG nova.network.neutron [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Instance network_info: |[{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Refreshing network info cache for port 9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Start _get_guest_xml network_info=[{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:11:51 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:51 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889132075',display_name='tempest-SnapshotDataIntegrityTests-server-1889132075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889132075',id=51,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOve7vNSsMTbKazf1QlaFqAiAytUewzGNp4TeNrH3BIm/J1cp301N4lSKHbu+LXC39N6SShVJkGYatNibmhUfo07gmDhYnQTebn6TVR+3/Q/Fmqcy4lzsg0+onxKg2/mBA==',key_name='tempest-keypair-86268744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93877720a16f4de29ec31812c0b70ecd',ramdisk_id='',reservation_id='r-tdsgv0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-5458625',owner_user_name='tempest-SnapshotDataIntegrityTests-5458625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0473a8d67f6a4e3f956744f43e1c97b6',uuid=543c9dcb-8e55-4423-a77b-1492b8044c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converting VIF {"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.objects.instance [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'pci_devices' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:11:51 user nova-compute[75463]:   <uuid>543c9dcb-8e55-4423-a77b-1492b8044c1b</uuid>
Nov 03 18:11:51 user nova-compute[75463]:   <name>instance-00000033</name>
Nov 03 18:11:51 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:11:51 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:11:51 user nova-compute[75463]:   <metadata>
Nov 03 18:11:51 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:11:51 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1889132075</nova:name>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:11:51</nova:creationTime>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:11:51 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:11:51 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:owner>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:user uuid="0473a8d67f6a4e3f956744f43e1c97b6">tempest-SnapshotDataIntegrityTests-5458625-project-member</nova:user>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:project uuid="93877720a16f4de29ec31812c0b70ecd">tempest-SnapshotDataIntegrityTests-5458625</nova:project>
Nov 03 18:11:51 user nova-compute[75463]:       </nova:owner>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 18:11:51 user nova-compute[75463]:       <nova:ports>
Nov 03 18:11:51 user nova-compute[75463]:         <nova:port uuid="9883196c-fd1f-4268-ba67-2371e41f2e9b">
Nov 03 18:11:51 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 03 18:11:51 user nova-compute[75463]:         </nova:port>
Nov 03 18:11:51 user nova-compute[75463]:       </nova:ports>
Nov 03 18:11:51 user nova-compute[75463]:     </nova:instance>
Nov 03 18:11:51 user nova-compute[75463]:   </metadata>
Nov 03 18:11:51 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:11:51 user nova-compute[75463]:     <system>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="serial">543c9dcb-8e55-4423-a77b-1492b8044c1b</entry>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="uuid">543c9dcb-8e55-4423-a77b-1492b8044c1b</entry>
Nov 03 18:11:51 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:11:51 user nova-compute[75463]:     </system>
Nov 03 18:11:51 user nova-compute[75463]:   </sysinfo>
Nov 03 18:11:51 user nova-compute[75463]:   <os>
Nov 03 18:11:51 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:11:51 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:11:51 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:11:51 user nova-compute[75463]:   </os>
Nov 03 18:11:51 user nova-compute[75463]:   <features>
Nov 03 18:11:51 user nova-compute[75463]:     <acpi/>
Nov 03 18:11:51 user nova-compute[75463]:     <apic/>
Nov 03 18:11:51 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:11:51 user nova-compute[75463]:   </features>
Nov 03 18:11:51 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:11:51 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:11:51 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:11:51 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:11:51 user nova-compute[75463]:   </clock>
Nov 03 18:11:51 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:11:51 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:11:51 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:11:51 user nova-compute[75463]:   </cpu>
Nov 03 18:11:51 user nova-compute[75463]:   <devices>
Nov 03 18:11:51 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 18:11:51 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 18:11:51 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk"/>
Nov 03 18:11:51 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:11:51 user nova-compute[75463]:     </disk>
Nov 03 18:11:51 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:11:51 user nova-compute[75463]:       <mac address="fa:16:3e:0b:62:ad"/>
Nov 03 18:11:51 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:11:51 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:11:51 user nova-compute[75463]:       <target dev="tap9883196c-fd"/>
Nov 03 18:11:51 user nova-compute[75463]:     </interface>
Nov 03 18:11:51 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:11:51 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/console.log" append="off"/>
Nov 03 18:11:51 user nova-compute[75463]:     </serial>
Nov 03 18:11:51 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:11:51 user nova-compute[75463]:     <video>
Nov 03 18:11:51 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:11:51 user nova-compute[75463]:     </video>
Nov 03 18:11:51 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:11:51 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:11:51 user nova-compute[75463]:     </rng>
Nov 03 18:11:51 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:11:51 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:11:51 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:11:51 user nova-compute[75463]:     </memballoon>
Nov 03 18:11:51 user nova-compute[75463]:   </devices>
Nov 03 18:11:51 user nova-compute[75463]: </domain>
Nov 03 18:11:51 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889132075',display_name='tempest-SnapshotDataIntegrityTests-server-1889132075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889132075',id=51,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOve7vNSsMTbKazf1QlaFqAiAytUewzGNp4TeNrH3BIm/J1cp301N4lSKHbu+LXC39N6SShVJkGYatNibmhUfo07gmDhYnQTebn6TVR+3/Q/Fmqcy4lzsg0+onxKg2/mBA==',key_name='tempest-keypair-86268744',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93877720a16f4de29ec31812c0b70ecd',ramdisk_id='',reservation_id='r-tdsgv0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-5458625',owner_user_name='tempest-SnapshotDataIntegrityTests-5458625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0473a8d67f6a4e3f956744f43e1c97b6',uuid=543c9dcb-8e55-4423-a77b-1492b8044c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converting VIF {"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG os_vif [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f349ed79-b593-5d90-af05-3799f9ef12a5', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9883196c-fd, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9883196c-fd, col_values=(('qos', UUID('0272d802-f8fe-460b-882f-f5f60ab6119a')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9883196c-fd, col_values=(('external_ids', {'iface-id': '9883196c-fd1f-4268-ba67-2371e41f2e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:62:ad', 'vm-uuid': '543c9dcb-8e55-4423-a77b-1492b8044c1b'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:51 user nova-compute[75463]: INFO os_vif [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd')
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No VIF found with MAC fa:16:3e:0b:62:ad, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated VIF entry in instance network info cache for port 9883196c-fd1f-4268-ba67-2371e41f2e9b. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG nova.network.neutron [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:11:51 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-e89bbc8f-61ff-41d4-9087-a64653137030 req-685c15e9-3033-422c-9d33-ff4594e466d2 service nova] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:52 user nova-compute[75463]: DEBUG nova.compute.manager [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] No waiting events found dispatching network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:11:52 user nova-compute[75463]: WARNING nova.compute.manager [req-845322ab-9527-46b5-a007-7535e91519a0 req-958b431f-909e-4cd9-b7a6-a48576b517bb service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received unexpected event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b for instance with vm_state building and task_state spawning.
Nov 03 18:11:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:11:54 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Instance spawned successfully.
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:11:54 user nova-compute[75463]: INFO nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:54 user nova-compute[75463]: DEBUG nova.compute.manager [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] No waiting events found dispatching network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:11:54 user nova-compute[75463]: WARNING nova.compute.manager [req-a14dc25e-6ae1-4914-89d2-e433406589a3 req-ea5dcc8c-6837-4671-bda7-c351f1d7a225 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received unexpected event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b for instance with vm_state building and task_state spawning.
Nov 03 18:11:54 user nova-compute[75463]: INFO nova.compute.manager [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Took 6.31 seconds to build instance.
Nov 03 18:11:54 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-12a49821-871d-4b93-b91c-0e2eb5ba92ce tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.407s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:11:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:11:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:17 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:12:24 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:12:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:12:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:12:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:12:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:12:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:12:32 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:12:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:12:33 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:12:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.015323638916016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:12:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:12:34 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:12:34 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:12:34 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:12:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:12:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:12:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:12:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:12:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:12:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:13:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:10 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:13:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Starting instance... {{(pid=75463) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75463) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 03 18:13:21 user nova-compute[75463]: INFO nova.compute.claims [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Claim successful on node user
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Start building networks asynchronously for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Allocating IP information in the background. {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] allocate_for_instance() {{(pid=75463) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 03 18:13:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Start building block device mappings for instance. {{(pid=75463) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.policy [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbf83e69dd4345f38fde161d01102914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3eba73b878984f9cb9091d14dd951936', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75463) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Start spawning the instance on the hypervisor. {{(pid=75463) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Creating instance directory {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 03 18:13:21 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Creating image(s)
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "/opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "/opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "/opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:21 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.205s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk 1073741824 {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f,backing_fmt=raw /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk 1073741824" returned: 0 in 0.056s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "b95efc509cb48c020b1cc67b50ab80dbd931ef2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Successfully created port: c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b95efc509cb48c020b1cc67b50ab80dbd931ef2f --force-share --output=json" returned: 0 in 0.183s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk. size=1073741824 {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG nova.virt.disk.api [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Cannot resize image /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk to a smaller size. {{(pid=75463) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Created local disks {{(pid=75463) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Ensure instance console log exists: /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/console.log {{(pid=75463) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:22 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Successfully updated port: c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquired lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Building network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-changed-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.compute.manager [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Refreshing instance network info cache due to event network-changed-c15c6ea9-3647-425e-b50c-dfbe35aad9e7. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] Acquiring lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Instance cache missing network info. {{(pid=75463) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Updating instance_info_cache with network_info: [{"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Releasing lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Instance network_info: |[{"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75463) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] Acquired lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Refreshing network info cache for port c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Start _get_guest_xml network_info=[{"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'cf8a3394-bcc6-4ef0-a69c-469776200bf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 03 18:13:23 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:13:23 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU controller missing on host. {{(pid=75463) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.host [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU controller found on host. {{(pid=75463) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75463) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-03T17:24:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-03T17:25:09Z,direct_url=<?>,disk_format='qcow2',id=cf8a3394-bcc6-4ef0-a69c-469776200bf6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='01ba08eebc2c4cf88c99391ca06e1bcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-03T17:25:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Flavor limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Image limits 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Flavor pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Image pref 0:0:0 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75463) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Got 1 possible topologies {{(pid=75463) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.hardware [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75463) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1120734333',display_name='tempest-ServersNegativeTestJSON-server-1120734333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1120734333',id=52,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-cvbgleb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:13:22Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=40c3292c-0424-4d48-a3c5-9c93bc32e22d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75463) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.objects.instance [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lazy-loading 'pci_devices' on Instance uuid 40c3292c-0424-4d48-a3c5-9c93bc32e22d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] End _get_guest_xml xml=<domain type="kvm">
Nov 03 18:13:23 user nova-compute[75463]:   <uuid>40c3292c-0424-4d48-a3c5-9c93bc32e22d</uuid>
Nov 03 18:13:23 user nova-compute[75463]:   <name>instance-00000034</name>
Nov 03 18:13:23 user nova-compute[75463]:   <memory>524288</memory>
Nov 03 18:13:23 user nova-compute[75463]:   <vcpu>1</vcpu>
Nov 03 18:13:23 user nova-compute[75463]:   <metadata>
Nov 03 18:13:23 user nova-compute[75463]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 03 18:13:23 user nova-compute[75463]:       <nova:package version="0.0.0"/>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:name>tempest-ServersNegativeTestJSON-server-1120734333</nova:name>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:creationTime>2023-11-03 18:13:23</nova:creationTime>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:flavor name="m1.tiny">
Nov 03 18:13:23 user nova-compute[75463]:         <nova:memory>512</nova:memory>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:disk>1</nova:disk>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:swap>0</nova:swap>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:ephemeral>0</nova:ephemeral>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:vcpus>1</nova:vcpus>
Nov 03 18:13:23 user nova-compute[75463]:       </nova:flavor>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:owner>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:user uuid="bbf83e69dd4345f38fde161d01102914">tempest-ServersNegativeTestJSON-1934338688-project-member</nova:user>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:project uuid="3eba73b878984f9cb9091d14dd951936">tempest-ServersNegativeTestJSON-1934338688</nova:project>
Nov 03 18:13:23 user nova-compute[75463]:       </nova:owner>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:root type="image" uuid="cf8a3394-bcc6-4ef0-a69c-469776200bf6"/>
Nov 03 18:13:23 user nova-compute[75463]:       <nova:ports>
Nov 03 18:13:23 user nova-compute[75463]:         <nova:port uuid="c15c6ea9-3647-425e-b50c-dfbe35aad9e7">
Nov 03 18:13:23 user nova-compute[75463]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 03 18:13:23 user nova-compute[75463]:         </nova:port>
Nov 03 18:13:23 user nova-compute[75463]:       </nova:ports>
Nov 03 18:13:23 user nova-compute[75463]:     </nova:instance>
Nov 03 18:13:23 user nova-compute[75463]:   </metadata>
Nov 03 18:13:23 user nova-compute[75463]:   <sysinfo type="smbios">
Nov 03 18:13:23 user nova-compute[75463]:     <system>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="product">OpenStack Nova</entry>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="version">0.0.0</entry>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="serial">40c3292c-0424-4d48-a3c5-9c93bc32e22d</entry>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="uuid">40c3292c-0424-4d48-a3c5-9c93bc32e22d</entry>
Nov 03 18:13:23 user nova-compute[75463]:       <entry name="family">Virtual Machine</entry>
Nov 03 18:13:23 user nova-compute[75463]:     </system>
Nov 03 18:13:23 user nova-compute[75463]:   </sysinfo>
Nov 03 18:13:23 user nova-compute[75463]:   <os>
Nov 03 18:13:23 user nova-compute[75463]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 03 18:13:23 user nova-compute[75463]:     <boot dev="hd"/>
Nov 03 18:13:23 user nova-compute[75463]:     <smbios mode="sysinfo"/>
Nov 03 18:13:23 user nova-compute[75463]:   </os>
Nov 03 18:13:23 user nova-compute[75463]:   <features>
Nov 03 18:13:23 user nova-compute[75463]:     <acpi/>
Nov 03 18:13:23 user nova-compute[75463]:     <apic/>
Nov 03 18:13:23 user nova-compute[75463]:     <vmcoreinfo/>
Nov 03 18:13:23 user nova-compute[75463]:   </features>
Nov 03 18:13:23 user nova-compute[75463]:   <clock offset="utc">
Nov 03 18:13:23 user nova-compute[75463]:     <timer name="pit" tickpolicy="delay"/>
Nov 03 18:13:23 user nova-compute[75463]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 03 18:13:23 user nova-compute[75463]:     <timer name="hpet" present="no"/>
Nov 03 18:13:23 user nova-compute[75463]:   </clock>
Nov 03 18:13:23 user nova-compute[75463]:   <cpu mode="custom" match="exact">
Nov 03 18:13:23 user nova-compute[75463]:     <model>Nehalem</model>
Nov 03 18:13:23 user nova-compute[75463]:     <topology sockets="1" cores="1" threads="1"/>
Nov 03 18:13:23 user nova-compute[75463]:   </cpu>
Nov 03 18:13:23 user nova-compute[75463]:   <devices>
Nov 03 18:13:23 user nova-compute[75463]:     <disk type="file" device="disk">
Nov 03 18:13:23 user nova-compute[75463]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 03 18:13:23 user nova-compute[75463]:       <source file="/opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk"/>
Nov 03 18:13:23 user nova-compute[75463]:       <target dev="vda" bus="virtio"/>
Nov 03 18:13:23 user nova-compute[75463]:     </disk>
Nov 03 18:13:23 user nova-compute[75463]:     <interface type="ethernet">
Nov 03 18:13:23 user nova-compute[75463]:       <mac address="fa:16:3e:89:8e:81"/>
Nov 03 18:13:23 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:13:23 user nova-compute[75463]:       <mtu size="1442"/>
Nov 03 18:13:23 user nova-compute[75463]:       <target dev="tapc15c6ea9-36"/>
Nov 03 18:13:23 user nova-compute[75463]:     </interface>
Nov 03 18:13:23 user nova-compute[75463]:     <serial type="pty">
Nov 03 18:13:23 user nova-compute[75463]:       <log file="/opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/console.log" append="off"/>
Nov 03 18:13:23 user nova-compute[75463]:     </serial>
Nov 03 18:13:23 user nova-compute[75463]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 03 18:13:23 user nova-compute[75463]:     <video>
Nov 03 18:13:23 user nova-compute[75463]:       <model type="virtio"/>
Nov 03 18:13:23 user nova-compute[75463]:     </video>
Nov 03 18:13:23 user nova-compute[75463]:     <rng model="virtio">
Nov 03 18:13:23 user nova-compute[75463]:       <backend model="random">/dev/urandom</backend>
Nov 03 18:13:23 user nova-compute[75463]:     </rng>
Nov 03 18:13:23 user nova-compute[75463]:     <controller type="usb" index="0" model="none"/>
Nov 03 18:13:23 user nova-compute[75463]:     <memballoon model="virtio">
Nov 03 18:13:23 user nova-compute[75463]:       <stats period="10"/>
Nov 03 18:13:23 user nova-compute[75463]:     </memballoon>
Nov 03 18:13:23 user nova-compute[75463]:   </devices>
Nov 03 18:13:23 user nova-compute[75463]: </domain>
Nov 03 18:13:23 user nova-compute[75463]:  {{(pid=75463) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1120734333',display_name='tempest-ServersNegativeTestJSON-server-1120734333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1120734333',id=52,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-cvbgleb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-03T18:13:22Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=40c3292c-0424-4d48-a3c5-9c93bc32e22d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG os_vif [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36') {{(pid=75463) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39ad12d8-68d3-582f-a880-a682aaf33cb6', '_type': 'linux-noop'}}, row=False) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc15c6ea9-36, may_exist=True, interface_attrs={}) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc15c6ea9-36, col_values=(('qos', UUID('e64770e1-70ca-4265-928e-bcbb4600c957')),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc15c6ea9-36, col_values=(('external_ids', {'iface-id': 'c15c6ea9-3647-425e-b50c-dfbe35aad9e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:8e:81', 'vm-uuid': '40c3292c-0424-4d48-a3c5-9c93bc32e22d'}),), if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:23 user nova-compute[75463]: INFO os_vif [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36')
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] No VIF found with MAC fa:16:3e:89:8e:81, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Updated VIF entry in instance network info cache for port c15c6ea9-3647-425e-b50c-dfbe35aad9e7. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG nova.network.neutron [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Updating instance_info_cache with network_info: [{"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:13:23 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-b4094dfc-0c97-4b5b-bf31-48f9acdc6bcb req-1cbf5598-7c97-4ed9-8c71-d015b5b867d8 service nova] Releasing lock "refresh_cache-40c3292c-0424-4d48-a3c5-9c93bc32e22d" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:13:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:24 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG nova.compute.manager [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] No waiting events found dispatching network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:13:25 user nova-compute[75463]: WARNING nova.compute.manager [req-5a7888dd-d740-4b74-9628-229cacb4608e req-d1b5ecf6-71c9-4f65-9f25-f338e1110705 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received unexpected event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 for instance with vm_state building and task_state spawning.
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:13:25 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:13:26 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:13:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:13:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:13:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Instance event wait completed in 0 seconds for  {{(pid=75463) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Guest created on hypervisor {{(pid=75463) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 03 18:13:27 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Instance spawned successfully.
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_cdrom_bus of ide {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_disk_bus of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_input_bus of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_pointer_model of None {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_video_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Found default for hw_vif_model of virtio {{(pid=75463) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 03 18:13:27 user nova-compute[75463]: INFO nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Checking state {{(pid=75463) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.compute.manager [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] No waiting events found dispatching network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:13:27 user nova-compute[75463]: WARNING nova.compute.manager [req-1294635a-879d-4b8b-acb8-9268549291f8 req-ae7bff79-5692-4827-b03f-3418dc26bea1 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received unexpected event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 for instance with vm_state building and task_state spawning.
Nov 03 18:13:27 user nova-compute[75463]: INFO nova.compute.manager [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Took 5.96 seconds to build instance.
Nov 03 18:13:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-118b4f88-1c1a-414c-a2f3-5a98ca93bcc0 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.050s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:13:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:13:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=25.013668060302734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 40c3292c-0424-4d48-a3c5-9c93bc32e22d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:13:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-changed-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Refreshing instance network info cache due to event network-changed-9883196c-fd1f-4268-ba67-2371e41f2e9b. {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Refreshing network info cache for port 9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated VIF entry in instance network info cache for port 9883196c-fd1f-4268-ba67-2371e41f2e9b. {{(pid=75463) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG nova.network.neutron [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:13:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5514026c-5c15-4fa0-aa9a-401bd5146dfe req-d4d3875c-bc18-4b32-b3c0-ff1e71c814ed service nova] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:13:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:13:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:45 user nova-compute[75463]: DEBUG nova.objects.instance [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:13:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:13:46 user nova-compute[75463]: INFO nova.compute.manager [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attaching volume aebb9b6c-5c25-4f6a-8e49-138c52ea65bc to /dev/vdb
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.utils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0870cf-cb48-4e88-8c4f-7c70b5c53797]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c7cc77-0a3c-4363-af9e-6246cde32bc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ad5c2-1206-497f-a43a-5aa6443b20c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d3d144-ddeb-4b39-ade3-b801c597e4c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:13:46 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:13:46 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[be863790-8db6-4d01-ac7d-cbbfd45411d4]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG os_brick.utils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:13:46 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating existing volume attachment record: 3e70afb2-9b72-4b63-a445-dfa4de366152 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:13:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:13:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaIZLwJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:14:06 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:14:06 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:14:06 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa5e24-b997-4dc4-9a5d-e66d265a2ba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:14:06 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3201b4a2-7ae0-4277-996d-5da7bb8a407d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc] added
Nov 03 18:14:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfed13e-957c-421d-b46c-c749cb3103a5]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b1b3bd-732f-4664-85b3-dd2832553207]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaIZLwJu {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaIZLwJu" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[92882c36-bf03-4f99-95a3-4a30708f384c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaIZLwJu'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa499d-cbfa-4623-8c7d-4e96366fa2fc]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[410379bc-76a1-4a37-9b56-7710e54c780f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:14:06 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:14:06 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:14:06 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 18:14:06 user nova-compute[75463]: 
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13f9fe-8ca6-4d86-bdc3-46cfc8325639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260]
Nov 03 18:14:06 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260] successful.
Nov 03 18:14:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fc08d-f4f9-43fb-af76-4726136f5e5a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe3b32b-fcea-4d82-85c5-856278a3c7c1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)
Nov 03 18:14:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)
Nov 03 18:14:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981b26c-df53-4793-ba81-b1ff2012afaf]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:14:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaIZLwJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23931316235373830', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931316235373830', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.objects.instance [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:14:07 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:14:07 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:14:07 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:14:07 user nova-compute[75463]:   <serial>aebb9b6c-5c25-4f6a-8e49-138c52ea65bc</serial>
Nov 03 18:14:07 user nova-compute[75463]: </disk>
Nov 03 18:14:07 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:14:07 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No VIF found with MAC fa:16:3e:0b:62:ad, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:14:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-bf27ce3c-cb3d-423d-b778-63ceef2b587f tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.988s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:14:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:12 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:23 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:14:26 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:14:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:14:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:14:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:14:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:14:28 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:14:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:14:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:14:35 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=24.98446273803711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 40c3292c-0424-4d48-a3c5-9c93bc32e22d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:14:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:14:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:14:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:14:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:14:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:14:45 user nova-compute[75463]: INFO nova.compute.manager [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Detaching volume aebb9b6c-5c25-4f6a-8e49-138c52ea65bc
Nov 03 18:14:45 user nova-compute[75463]: INFO nova.virt.block_device [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attempting to driver detach volume aebb9b6c-5c25-4f6a-8e49-138c52ea65bc from mountpoint /dev/vdb
Nov 03 18:14:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Attempting to detach device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:14:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:14:45 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:14:45 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:14:45 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:14:45 user nova-compute[75463]:   <serial>aebb9b6c-5c25-4f6a-8e49-138c52ea65bc</serial>
Nov 03 18:14:45 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:14:45 user nova-compute[75463]: </disk>
Nov 03 18:14:45 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:14:45 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config.
Nov 03 18:14:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:14:45 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:14:45 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:14:45 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:14:45 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:14:45 user nova-compute[75463]:   <serial>aebb9b6c-5c25-4f6a-8e49-138c52ea65bc</serial>
Nov 03 18:14:45 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:14:45 user nova-compute[75463]: </disk>
Nov 03 18:14:45 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:14:46 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:14:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:14:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:06 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b is timed out.
Nov 03 18:15:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config.
Nov 03 18:15:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaIZLwJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:15:06 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4883c24-0d84-4a73-8438-cd7477e8a1d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:15:06 user nova-compute[75463]: No targets found.
Nov 03 18:15:06 user nova-compute[75463]: iSNS:
Nov 03 18:15:06 user nova-compute[75463]: No targets found.
Nov 03 18:15:06 user nova-compute[75463]: STATIC:
Nov 03 18:15:06 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc
Nov 03 18:15:06 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:15:06 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:15:06 user nova-compute[75463]: FIRMWARE:
Nov 03 18:15:06 user nova-compute[75463]: No targets found.
Nov 03 18:15:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:15:06 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:15:06 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dd1e7-ccda-4b14-a151-b59dd2b1cbdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85d345d-c169-4163-88e4-77c30581ad9f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)
Nov 03 18:15:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc (non-flash)
Nov 03 18:15:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec5876d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc4154-cbaf-463c-9442-acf058547651]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b719c-1a76-4f50-9ebf-b7a7a2c32d6b]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7eb2d-da20-4cee-a207-d0201cc31c6f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0debfa-28a2-48b7-a99a-35868ed0d930]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e4add-b132-4698-bfd8-57527887879c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[266c9b83-5c01-4866-b58f-266c92c91198]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260]
Nov 03 18:15:06 user nova-compute[75463]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc, portal: 172.16.0.220,3260] successful.
Nov 03 18:15:06 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb9b6c-5c25-4f6a-8e49-138c52ea65bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd79ad8-54c8-40b7-9e35-f67dff9ea655]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== disconnect_volume: return (284ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:15:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:15:07 user nova-compute[75463]: DEBUG nova.objects.instance [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:15:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-47d3d186-f353-4f6e-b5aa-33bfc05575ec tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:08 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:11 user nova-compute[75463]: INFO nova.compute.manager [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Terminating instance
Nov 03 18:15:11 user nova-compute[75463]: DEBUG nova.compute.manager [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-unplugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] No waiting events found dispatching network-vif-unplugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:15:11 user nova-compute[75463]: DEBUG nova.compute.manager [req-74128e42-58c1-49eb-9d0a-b34383c98d94 req-b3b97ae4-7a61-43ef-a0e9-ed655639a5a7 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-unplugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Instance destroyed successfully.
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.objects.instance [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lazy-loading 'resources' on Instance uuid 40c3292c-0424-4d48-a3c5-9c93bc32e22d {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1120734333',display_name='tempest-ServersNegativeTestJSON-server-1120734333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1120734333',id=52,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-cvbgleb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:13:27Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=40c3292c-0424-4d48-a3c5-9c93bc32e22d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "address": "fa:16:3e:89:8e:81", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc15c6ea9-36", "ovs_interfaceid": "c15c6ea9-3647-425e-b50c-dfbe35aad9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG os_vif [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc15c6ea9-36, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e64770e1-70ca-4265-928e-bcbb4600c957) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:15:12 user nova-compute[75463]: INFO os_vif [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8e:81,bridge_name='br-int',has_traffic_filtering=True,id=c15c6ea9-3647-425e-b50c-dfbe35aad9e7,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc15c6ea9-36')
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Deleting instance files /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d_del
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Deletion of /opt/stack/data/nova/instances/40c3292c-0424-4d48-a3c5-9c93bc32e22d_del complete
Nov 03 18:15:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.compute.manager [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 03 18:15:12 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Took 0.47 seconds to deallocate network for instance.
Nov 03 18:15:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.compute.manager [req-8f7c97d7-4725-4a85-8a81-abb941416009 req-eb6fc912-b204-4faf-9261-14abae50b39f service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-deleted-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:15:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:12 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Deleted allocations for instance 40c3292c-0424-4d48-a3c5-9c93bc32e22d
Nov 03 18:15:12 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-190e2fef-3093-4687-94a6-f4e3b30c043f tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.463s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:15:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] Acquiring lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] Lock "40c3292c-0424-4d48-a3c5-9c93bc32e22d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:13 user nova-compute[75463]: DEBUG nova.compute.manager [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] No waiting events found dispatching network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:15:13 user nova-compute[75463]: WARNING nova.compute.manager [req-fe4d3a38-aaa3-4e89-a1c5-03c24c3c74e0 req-a6457045-5cae-45b4-a08d-56186ccd43d9 service nova] [instance: 40c3292c-0424-4d48-a3c5-9c93bc32e22d] Received unexpected event network-vif-plugged-c15c6ea9-3647-425e-b50c-dfbe35aad9e7 for instance with vm_state deleted and task_state None.
Nov 03 18:15:14 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:15:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:15:26 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:15:26 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:15:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:15:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:15:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:15:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:15:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:15:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:15:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.011493682861328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:15:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:41 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:15:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:15:42 user nova-compute[75463]: INFO nova.compute.manager [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attaching volume 883f6824-c4e1-4e57-ad91-bf42f8011b02 to /dev/vdb
Nov 03 18:15:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.utils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[455532a3-5486-42ae-80e9-bfb019fd843b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e7d7d-dbad-4886-b2a7-36385b704fed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15770b-1165-44f0-8aa1-329d08407340]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83eee7-aa73-470d-9d43-9c72e630e7ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:15:42 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:15:42 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b44ce7-16e4-43a0-8cb5-fb7b7e93f280]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG os_brick.utils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:15:42 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating existing volume attachment record: fbc8dddc-aaa7-4533-858f-40dc9b01379e {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:15:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:15:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:15:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:44 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:15:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:15:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:15:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:16:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVWeypxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:16:13 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:16:13 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:16:13 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc0ef30-2b99-42d7-ae63-cdebc3211183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:16:13 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec90b80-5e95-4cd8-b16d-8da44c131d16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02] added
Nov 03 18:16:13 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec306919-1366-486e-a26c-08764902eb1b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da43b33c-adf0-47e0-8897-0487eefbc88c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVWeypxo {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVWeypxo" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f6c95-7bf9-40ac-a132-15669e6bee84]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVWeypxo'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab5dc4-e0ed-443a-b70b-012364c7654a]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1127c6-c506-45d4-9617-3de1f92750a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:16:13 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:16:13 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:16:13 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 18:16:13 user nova-compute[75463]: 
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[397600d2-6721-41ee-9047-648d9079d0f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260]
Nov 03 18:16:13 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260] successful.
Nov 03 18:16:13 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb4b06-40b3-4354-b5ac-b4adde2b0702]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac5eaf9-bbab-4879-93c5-a8e8941cd67c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)
Nov 03 18:16:13 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)
Nov 03 18:16:13 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c0b22b-127a-45b2-8970-5818a7795da6]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:13 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVWeypxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26262343138336239', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262343138336239', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.objects.instance [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:16:14 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:16:14 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:16:14 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:16:14 user nova-compute[75463]:   <serial>883f6824-c4e1-4e57-ad91-bf42f8011b02</serial>
Nov 03 18:16:14 user nova-compute[75463]: </disk>
Nov 03 18:16:14 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:16:14 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No VIF found with MAC fa:16:3e:0b:62:ad, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:16:15 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-e9001057-0670-4d8a-9b94-d0a02aa3e959 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.034s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:16:15 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:16:17 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:16:17 user nova-compute[75463]: INFO nova.compute.manager [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Detaching volume 883f6824-c4e1-4e57-ad91-bf42f8011b02
Nov 03 18:16:17 user nova-compute[75463]: INFO nova.virt.block_device [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attempting to driver detach volume 883f6824-c4e1-4e57-ad91-bf42f8011b02 from mountpoint /dev/vdb
Nov 03 18:16:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Attempting to detach device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:16:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:16:17 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:16:17 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:16:17 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:16:17 user nova-compute[75463]:   <serial>883f6824-c4e1-4e57-ad91-bf42f8011b02</serial>
Nov 03 18:16:17 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:16:17 user nova-compute[75463]: </disk>
Nov 03 18:16:17 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:16:17 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config.
Nov 03 18:16:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:16:17 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:16:17 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:16:17 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:16:17 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:16:17 user nova-compute[75463]:   <serial>883f6824-c4e1-4e57-ad91-bf42f8011b02</serial>
Nov 03 18:16:17 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:16:17 user nova-compute[75463]: </disk>
Nov 03 18:16:17 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:16:18 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:16:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:16:26 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:16:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:16:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:16:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:16:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.010356903076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:16:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:16:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:16:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:16:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:16:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:16:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:38 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b is timed out.
Nov 03 18:16:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config.
Nov 03 18:16:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVWeypxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:16:38 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cac3f5-c176-46c1-b16e-67e61fafc8b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:16:38 user nova-compute[75463]: No targets found.
Nov 03 18:16:38 user nova-compute[75463]: iSNS:
Nov 03 18:16:38 user nova-compute[75463]: No targets found.
Nov 03 18:16:38 user nova-compute[75463]: STATIC:
Nov 03 18:16:38 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02
Nov 03 18:16:38 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:16:38 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:16:38 user nova-compute[75463]: FIRMWARE:
Nov 03 18:16:38 user nova-compute[75463]: No targets found.
Nov 03 18:16:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:16:38 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:16:38 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c57468-0e32-46f9-8b28-d5a461b6f89c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[306855d9-cd8a-43a9-99e6-8c0567c53fc2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)
Nov 03 18:16:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 (non-flash)
Nov 03 18:16:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec2ec550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[081aff51-0477-426b-9334-c1ef4cbeee67]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ce9f4-7bda-4394-b30d-6632b3c99a4f]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b69a5-4e79-4611-a1e7-b4993504de10]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe6491a-a91c-4c37-9b27-e004b269b6ec]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10fe5dc-0f87-494a-b7c4-ccf4279e5dce]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b7df83-4447-4c6d-9cdd-49aa1258797b]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260]
Nov 03 18:16:38 user nova-compute[75463]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02, portal: 172.16.0.220,3260] successful.
Nov 03 18:16:38 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f6824-c4e1-4e57-ad91-bf42f8011b02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a9732e-9a75-4128-90ef-cfdd9474fc5c]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== disconnect_volume: return (292ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:16:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:16:39 user nova-compute[75463]: DEBUG nova.objects.instance [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:16:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-5c07ab0c-fde5-4085-becd-7056401c0ed6 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:16:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:16:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:16:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Triggering sync for uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:16:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:17:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:17:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG nova.objects.instance [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:17:13 user nova-compute[75463]: INFO nova.compute.manager [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attaching volume 35a19c31-1939-4eca-9267-907c30fe7abc to /dev/vdb
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.utils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2f87a-3209-4697-afbd-55e2ff9eef4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145e54f-163e-48c9-aed2-8800a286ba5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75479354-05b2-4574-9500-8ddbd7139557]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e2d8c-a85d-48fd-9872-8240bd12444e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:17:13 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:17:13 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50fad1-159f-40c2-a0d8-fbbf3bcadb5d]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG os_brick.utils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating existing volume attachment record: 38c372cb-cd64-42d7-b2e3-4410c117f4c3 {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:17:13 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:18 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:17:27 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:17:28 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:17:28 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:17:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:17:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:28 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:17:31 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpcoSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:17:33 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:17:33 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:17:33 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2a521-ef80-4a0d-9f4f-ba76c34a5e2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:17:33 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1343296f-126c-46b1-8885-e580be1e9691]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc] added
Nov 03 18:17:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229a30f-5aa8-4963-8741-caea81cfc23f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d09075-9cc2-4ea8-a59e-d7037d8d044e]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpcoSvBl {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpcoSvBl" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a3843f-dbda-4fea-a5d0-0e3bce08742f]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpcoSvBl'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[808debb2-d455-46bc-9a29-363cbcaafd34]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1234e9a-3ee6-4724-87ff-54961d513dec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:17:33 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:17:33 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:17:33 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 18:17:33 user nova-compute[75463]: 
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733307e-5328-4d81-8f7d-9e702d777247]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260]
Nov 03 18:17:33 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260] successful.
Nov 03 18:17:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[727490e9-d6bd-402b-b4a5-8bf86dd470dd]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7930e4be-a77f-44fd-8220-43a19a4c23cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)
Nov 03 18:17:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)
Nov 03 18:17:33 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee80d8-6222-44f2-a665-0144e0f0ebf2]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:33 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:17:34 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:17:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpcoSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:17:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:17:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26563356266303937', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:17:34 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563356266303937', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.objects.instance [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:17:35 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:17:35 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:17:35 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:17:35 user nova-compute[75463]:   <serial>35a19c31-1939-4eca-9267-907c30fe7abc</serial>
Nov 03 18:17:35 user nova-compute[75463]: </disk>
Nov 03 18:17:35 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No VIF found with MAC fa:16:3e:0b:62:ad, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-20c466ee-d57f-40e8-b002-85f5cb7c7854 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.331s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:35 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75463) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 03 18:17:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:17:36 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.009254455566406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:17:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:17:37 user nova-compute[75463]: INFO nova.compute.manager [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Detaching volume 35a19c31-1939-4eca-9267-907c30fe7abc
Nov 03 18:17:37 user nova-compute[75463]: INFO nova.virt.block_device [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attempting to driver detach volume 35a19c31-1939-4eca-9267-907c30fe7abc from mountpoint /dev/vdb
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Attempting to detach device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:17:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:17:37 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:17:37 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:17:37 user nova-compute[75463]:   <serial>35a19c31-1939-4eca-9267-907c30fe7abc</serial>
Nov 03 18:17:37 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:17:37 user nova-compute[75463]: </disk>
Nov 03 18:17:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:17:37 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config.
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:17:37 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:17:37 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:17:37 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:17:37 user nova-compute[75463]:   <serial>35a19c31-1939-4eca-9267-907c30fe7abc</serial>
Nov 03 18:17:37 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:17:37 user nova-compute[75463]: </disk>
Nov 03 18:17:37 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:17:37 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:17:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:53 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:17:57 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b is timed out.
Nov 03 18:17:57 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config.
Nov 03 18:17:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpcoSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:17:57 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fe57c6-9cd7-4fcf-9712-d2d35ad7f486]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:17:57 user nova-compute[75463]: No targets found.
Nov 03 18:17:57 user nova-compute[75463]: iSNS:
Nov 03 18:17:57 user nova-compute[75463]: No targets found.
Nov 03 18:17:57 user nova-compute[75463]: STATIC:
Nov 03 18:17:57 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc
Nov 03 18:17:57 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:17:57 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:17:57 user nova-compute[75463]: FIRMWARE:
Nov 03 18:17:57 user nova-compute[75463]: No targets found.
Nov 03 18:17:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:17:57 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:17:57 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d1fe26-7774-4b6d-91b9-a8dbeefba11b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64dd00e-8a64-495e-9163-db54a3cfb18f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)
Nov 03 18:17:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc (non-flash)
Nov 03 18:17:57 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec2ecaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e50a66-bd49-4f2f-ac95-5424d05e7d34]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd9388-025c-4d4d-9aea-072de3d53137]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd6434-b1ed-461e-b1c7-797f42d9d1b4]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a0ee4-0b8c-4ae6-9ee0-fcc54c1a359b]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eccb67-5981-4095-9073-78792dbbb6c6]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:57 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4838c-af58-4975-869a-5a74d3c7a9de]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260]
Nov 03 18:17:58 user nova-compute[75463]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc, portal: 172.16.0.220,3260] successful.
Nov 03 18:17:58 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a19c31-1939-4eca-9267-907c30fe7abc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[225dfa8b-a28a-490e-9987-c4d3b4f6e7fe]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== disconnect_volume: return (276ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG nova.objects.instance [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:17:58 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-fdb3f2ab-ee8b-4f79-a0b3-85ef604172d5 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:18:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:18:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:18:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:29 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:18:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:18:29 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:18:29 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:18:30 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:18:30 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:18:30 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:18:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:30 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:18:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG nova.objects.instance [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:18:34 user nova-compute[75463]: INFO nova.compute.manager [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attaching volume 10a3d6cc-8d23-47ae-8347-47968af3eddf to /dev/vdb
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.utils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[000224ad-99b5-420e-8be8-83b1443017eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d45fea5bd30\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf181772-afa0-4cdb-afb2-73be696ac898]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca7a12-bff5-46b5-99f4-2c11a0bd90ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[116f43de-7588-4a30-b95c-c8b1829bb81b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Running cmd (subprocess): nvme version {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] 'nvme version' failed. Not Retrying. {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] nvme not present on system {{(pid=75463) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 03 18:18:34 user nova-compute[75463]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 03 18:18:34 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6f29d-fcc8-435a-a708-e4cffc06f011]: (4, '') {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75463) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.lightos [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] LIGHTOS: no hostnqn found. {{(pid=75463) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG os_brick.utils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d45fea5bd30', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:18:34 user nova-compute[75463]: DEBUG nova.virt.block_device [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating existing volume attachment record: 92870684-a6ca-4d2f-b31a-718de003992e {{(pid=75463) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:36 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:18:37 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:18:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.00838851928711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:18:37 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:18:38 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:18:38 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:18:38 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:18:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:18:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:18:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:18:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Calling os-brick to attach iSCSI Volume {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhnauBsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:18:55 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:18:55 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:18:55 user nova-compute[75463]: INFO os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e8d75-d33e-4780-823f-ded5ee4be5d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 03 18:18:55 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --interface default --op new {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99779a9c-704f-48b3-8ff1-a170a13b6109]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf] added\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf] added
Nov 03 18:18:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa1002-bf12-4def-a0cc-14281c064c46]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a74fcd-7236-4482-a164-3efaec592d94]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhnauBsz {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhnauBsz" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b851e45-88de-4aae-a268-51b3aeb8cb1b]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhnauBsz'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e094752-1beb-4506-abcb-d4d04c204a21]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[174391f2-8b3b-4a4d-aa79-ed4526b264a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:18:55 user nova-compute[75463]:  {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 03 18:18:55 user nova-compute[75463]:  {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:18:55 user nova-compute[75463]: WARNING os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 03 18:18:55 user nova-compute[75463]: 
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --login {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971a100-102d-4254-b0e0-6d17b854b946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260]
Nov 03 18:18:55 user nova-compute[75463]: Login to [iface: default, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260] successful.
Nov 03 18:18:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97a64e4-8cfb-4a6d-bf9a-d2c392fb6fc3]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542f933-c7cb-431a-8b8c-2ac99e364038]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)
Nov 03 18:18:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)
Nov 03 18:18:55 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to 172.16.0.220:3260 {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75463) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75463) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a6e7f-e483-4b0a-ad15-5108ace838a6]: (4, ('- - 0', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:18:55 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75463) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhnauBsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75463) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23234626132613531', 'path': '/dev/sdb'} {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626132613531', 'path': '/dev/sdb'} {{(pid=75463) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG nova.objects.instance [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:18:56 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] attach device xml: <disk type="block" device="disk">
Nov 03 18:18:56 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:18:56 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:18:56 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:18:56 user nova-compute[75463]:   <serial>10a3d6cc-8d23-47ae-8347-47968af3eddf</serial>
Nov 03 18:18:56 user nova-compute[75463]: </disk>
Nov 03 18:18:56 user nova-compute[75463]:  {{(pid=75463) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 03 18:18:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vda, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:18:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75463) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 03 18:18:57 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] No VIF found with MAC fa:16:3e:0b:62:ad, not building metadata {{(pid=75463) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 03 18:18:57 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-30150f15-dc99-4963-9d9d-ebf3af0a3c63 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.545s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:18:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:18:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:18:59 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:18:59 user nova-compute[75463]: INFO nova.compute.manager [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Detaching volume 10a3d6cc-8d23-47ae-8347-47968af3eddf
Nov 03 18:18:59 user nova-compute[75463]: INFO nova.virt.block_device [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Attempting to driver detach volume 10a3d6cc-8d23-47ae-8347-47968af3eddf from mountpoint /dev/vdb
Nov 03 18:18:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Attempting to detach device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config. {{(pid=75463) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 03 18:18:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:18:59 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:18:59 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:18:59 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:18:59 user nova-compute[75463]:   <serial>10a3d6cc-8d23-47ae-8347-47968af3eddf</serial>
Nov 03 18:18:59 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:18:59 user nova-compute[75463]: </disk>
Nov 03 18:18:59 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:18:59 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the persistent domain config.
Nov 03 18:18:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config. {{(pid=75463) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 03 18:18:59 user nova-compute[75463]: DEBUG nova.virt.libvirt.guest [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] detach device xml: <disk type="block" device="disk">
Nov 03 18:18:59 user nova-compute[75463]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 03 18:18:59 user nova-compute[75463]:   <source dev="/dev/sdb"/>
Nov 03 18:18:59 user nova-compute[75463]:   <target dev="vdb" bus="virtio"/>
Nov 03 18:18:59 user nova-compute[75463]:   <serial>10a3d6cc-8d23-47ae-8347-47968af3eddf</serial>
Nov 03 18:18:59 user nova-compute[75463]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 03 18:18:59 user nova-compute[75463]: </disk>
Nov 03 18:18:59 user nova-compute[75463]:  {{(pid=75463) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 03 18:19:00 user nova-compute[75463]: DEBUG nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 03 18:19:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:16 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:20 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b is timed out.
Nov 03 18:19:20 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully detached device vdb from instance 543c9dcb-8e55-4423-a77b-1492b8044c1b from the live domain config.
Nov 03 18:19:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] calling os-brick to detach iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe00c567460>, {'target_iqn': 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhnauBsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 03 18:19:20 user nova-compute[75463]: WARNING os_brick.initiator.connectors.base [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca99899-1671-47f4-8913-b8da2fbb7ad5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 03 18:19:20 user nova-compute[75463]: No targets found.
Nov 03 18:19:20 user nova-compute[75463]: iSNS:
Nov 03 18:19:20 user nova-compute[75463]: No targets found.
Nov 03 18:19:20 user nova-compute[75463]: STATIC:
Nov 03 18:19:20 user nova-compute[75463]: Target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf
Nov 03 18:19:20 user nova-compute[75463]:         Portal: 172.16.0.220:3260,-1
Nov 03 18:19:20 user nova-compute[75463]:                 Iface Name: default
Nov 03 18:19:20 user nova-compute[75463]: FIRMWARE:
Nov 03 18:19:20 user nova-compute[75463]: No targets found.
Nov 03 18:19:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 03 18:19:20 user nova-compute[75463]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 03 18:19:20 user nova-compute[75463]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75463) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf', 0)] {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2583e7-baf8-4e5f-b631-42e607c24945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03b3b8-cc45-438c-ac0a-698b0c250920]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)
Nov 03 18:19:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf (non-flash)
Nov 03 18:19:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdfec2ed5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf'): ({'sdb'}, set())}) {{(pid=75463) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Removing single pathed devices sdb {{(pid=75463) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cfd9a9-fa2a-4933-b15e-9535af1a4e9c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38e4b2-f9db-4493-bd89-19cb5f15bef5]: (4, ('ok\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Flushing IO for device /dev/sdb {{(pid=75463) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d415d-6842-4912-b1a5-2e924ff14342]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75463) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1501eb2c-87fe-4e47-b69a-d6548e1d735e]: (4, ('1', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.linuxscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] SCSI volumes sdb have been removed. {{(pid=75463) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf')] {{(pid=75463) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d12314f-b581-4bb3-8823-8202c1bafda7]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --logout {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927a538-b192-479a-a60a-7cd99b4b5211]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260]
Nov 03 18:19:20 user nova-compute[75463]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf, portal: 172.16.0.220,3260] successful.
Nov 03 18:19:20 user nova-compute[75463]:  stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op delete {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10a3d6cc-8d23-47ae-8347-47968af3eddf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91b6be-6cf2-41ca-ae2c-b7e1c9531978]: (4, ('', '')) {{(pid=86919) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75463) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.base [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG os_brick.initiator.connectors.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] <== disconnect_volume: return (283ms) None {{(pid=75463) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 03 18:19:20 user nova-compute[75463]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Disconnected iSCSI Volume {{(pid=75463) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 03 18:19:21 user nova-compute[75463]: DEBUG nova.objects.instance [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'flavor' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:19:21 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-caeb1455-7d29-4c3e-bb84-437ed17b6899 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:19:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:23 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:19:31 user nova-compute[75463]: DEBUG nova.objects.instance [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lazy-loading 'info_cache' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [{"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-c55ea77f-b7b2-4389-9597-6b4062e861fb" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:32 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:19:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:38 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:19:39 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:19:39 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:19:39 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.00732421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance c55ea77f-b7b2-4389-9597-6b4062e861fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:19:39 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:19:40 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:19:40 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:19:40 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:19:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:19:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:19:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:19:47 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:52 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:19:57 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:19:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:07 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:12 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:22 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:25 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:27 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:32 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:33 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:20:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 03 18:20:33 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquired lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 03 18:20:33 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Forcefully refreshing network info cache for instance {{(pid=75463) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG nova.network.neutron [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [{"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Releasing lock "refresh_cache-543c9dcb-8e55-4423-a77b-1492b8044c1b" {{(pid=75463) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updated the network info_cache for instance {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:20:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:37 user nova-compute[75463]: INFO nova.compute.manager [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Terminating instance
Nov 03 18:20:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-unplugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] No waiting events found dispatching network-vif-unplugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG nova.compute.manager [req-5bfcffe0-de16-471e-9819-a85e03c85152 req-660f6e12-27ac-4b14-adaa-ae5b33305b77 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-unplugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:20:37 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Instance destroyed successfully.
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.objects.instance [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lazy-loading 'resources' on Instance uuid c55ea77f-b7b2-4389-9597-6b4062e861fb {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-972134974',display_name='tempest-ServersNegativeTestJSON-server-972134974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-972134974',id=50,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3eba73b878984f9cb9091d14dd951936',ramdisk_id='',reservation_id='r-o60m5exi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1934338688',owner_user_name='tempest-ServersNegativeTestJSON-1934338688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:11:38Z,user_data=None,user_id='bbf83e69dd4345f38fde161d01102914',uuid=c55ea77f-b7b2-4389-9597-6b4062e861fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converting VIF {"id": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "address": "fa:16:3e:a2:64:7d", "network": {"id": "bd042a42-7748-4bc8-b771-c09d1fd2011e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-866101871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3eba73b878984f9cb9091d14dd951936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec95b18e-67", "ovs_interfaceid": "ec95b18e-6734-4e5f-9e83-979c81e8fcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG os_vif [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec95b18e-67, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1050790-2aea-4720-b93f-fce32241c563) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:38 user nova-compute[75463]: INFO os_vif [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:64:7d,bridge_name='br-int',has_traffic_filtering=True,id=ec95b18e-6734-4e5f-9e83-979c81e8fcf1,network=Network(bd042a42-7748-4bc8-b771-c09d1fd2011e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec95b18e-67')
Nov 03 18:20:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Deleting instance files /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb_del
Nov 03 18:20:38 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Deletion of /opt/stack/data/nova/instances/c55ea77f-b7b2-4389-9597-6b4062e861fb_del complete
Nov 03 18:20:38 user nova-compute[75463]: INFO nova.compute.manager [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 03 18:20:38 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:20:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:20:39 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Took 0.71 seconds to deallocate network for instance.
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-62985dee-8fa0-4833-83ef-c15e8777ef18 req-ccc3089d-6b51-403e-8554-a98aab246fba service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-deleted-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:39 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Deleted allocations for instance c55ea77f-b7b2-4389-9597-6b4062e861fb
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-ab1cf707-2052-4cbd-ad90-e29fa89139d9 tempest-ServersNegativeTestJSON-1934338688 tempest-ServersNegativeTestJSON-1934338688-project-member] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] Acquiring lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] Lock "c55ea77f-b7b2-4389-9597-6b4062e861fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:39 user nova-compute[75463]: DEBUG nova.compute.manager [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] No waiting events found dispatching network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:20:39 user nova-compute[75463]: WARNING nova.compute.manager [req-92c58028-ea6b-43d6-b1a6-adc7e622c523 req-a2e088ff-4e28-41cf-8a43-60f38c83be52 service nova] [instance: c55ea77f-b7b2-4389-9597-6b4062e861fb] Received unexpected event network-vif-plugged-ec95b18e-6734-4e5f-9e83-979c81e8fcf1 for instance with vm_state deleted and task_state None.
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:20:40 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG oslo_concurrency.processutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 03 18:20:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:20:41 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.02606201171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75463) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:20:41 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:20:43 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:20:45 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:48 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:20:53 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:20:58 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:20:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:20:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:21:03 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:05 user nova-compute[75463]: INFO nova.compute.manager [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Terminating instance
Nov 03 18:21:05 user nova-compute[75463]: DEBUG nova.compute.manager [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Start destroying the instance on the hypervisor. {{(pid=75463) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-unplugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] No waiting events found dispatching network-vif-unplugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:21:05 user nova-compute[75463]: DEBUG nova.compute.manager [req-ac42b5d4-bec6-4c4d-afb0-025377332b8b req-db0435a0-2024-479b-9b48-d8a2014d80cd service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-unplugged-9883196c-fd1f-4268-ba67-2371e41f2e9b for instance with task_state deleting. {{(pid=75463) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 03 18:21:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Instance destroyed successfully.
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.objects.instance [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lazy-loading 'resources' on Instance uuid 543c9dcb-8e55-4423-a77b-1492b8044c1b {{(pid=75463) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.virt.libvirt.vif [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-03T18:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1889132075',display_name='tempest-SnapshotDataIntegrityTests-server-1889132075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1889132075',id=51,image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOve7vNSsMTbKazf1QlaFqAiAytUewzGNp4TeNrH3BIm/J1cp301N4lSKHbu+LXC39N6SShVJkGYatNibmhUfo07gmDhYnQTebn6TVR+3/Q/Fmqcy4lzsg0+onxKg2/mBA==',key_name='tempest-keypair-86268744',keypairs=<?>,launch_index=0,launched_at=2023-11-03T18:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93877720a16f4de29ec31812c0b70ecd',ramdisk_id='',reservation_id='r-tdsgv0dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='cf8a3394-bcc6-4ef0-a69c-469776200bf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-5458625',owner_user_name='tempest-SnapshotDataIntegrityTests-5458625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-03T18:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0473a8d67f6a4e3f956744f43e1c97b6',uuid=543c9dcb-8e55-4423-a77b-1492b8044c1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converting VIF {"id": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "address": "fa:16:3e:0b:62:ad", "network": {"id": "5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-767967142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93877720a16f4de29ec31812c0b70ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9883196c-fd", "ovs_interfaceid": "9883196c-fd1f-4268-ba67-2371e41f2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.network.os_vif_util [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd') {{(pid=75463) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG os_vif [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd') {{(pid=75463) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9883196c-fd, bridge=br-int, if_exists=True) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0272d802-f8fe-460b-882f-f5f60ab6119a) {{(pid=75463) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:06 user nova-compute[75463]: INFO os_vif [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:62:ad,bridge_name='br-int',has_traffic_filtering=True,id=9883196c-fd1f-4268-ba67-2371e41f2e9b,network=Network(5cb6d74b-ef4a-40db-bbf5-f04d8c3ebd51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9883196c-fd')
Nov 03 18:21:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Deleting instance files /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b_del
Nov 03 18:21:06 user nova-compute[75463]: INFO nova.virt.libvirt.driver [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Deletion of /opt/stack/data/nova/instances/543c9dcb-8e55-4423-a77b-1492b8044c1b_del complete
Nov 03 18:21:06 user nova-compute[75463]: INFO nova.compute.manager [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 03 18:21:06 user nova-compute[75463]: DEBUG oslo.service.loopingcall [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75463) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.compute.manager [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Deallocating network for instance {{(pid=75463) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 03 18:21:06 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] deallocate_for_instance() {{(pid=75463) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.network.neutron [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:21:07 user nova-compute[75463]: INFO nova.compute.manager [-] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Took 0.85 seconds to deallocate network for instance.
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-6e4b2b85-7a71-4988-8810-2504bbc4607c req-26f7bc8f-6712-47b3-8630-48c6421e5a33 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-deleted-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:21:07 user nova-compute[75463]: INFO nova.compute.manager [req-6e4b2b85-7a71-4988-8810-2504bbc4607c req-26f7bc8f-6712-47b3-8630-48c6421e5a33 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Neutron deleted interface 9883196c-fd1f-4268-ba67-2371e41f2e9b; detaching it from the instance and deleting it from the info cache
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.network.neutron [req-6e4b2b85-7a71-4988-8810-2504bbc4607c req-26f7bc8f-6712-47b3-8630-48c6421e5a33 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Updating instance_info_cache with network_info: [] {{(pid=75463) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.compute.manager [req-6e4b2b85-7a71-4988-8810-2504bbc4607c req-26f7bc8f-6712-47b3-8630-48c6421e5a33 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Detach interface failed, port_id=9883196c-fd1f-4268-ba67-2371e41f2e9b, reason: Instance 543c9dcb-8e55-4423-a77b-1492b8044c1b could not be found. {{(pid=75463) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:21:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:07 user nova-compute[75463]: INFO nova.scheduler.client.report [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Deleted allocations for instance 543c9dcb-8e55-4423-a77b-1492b8044c1b
Nov 03 18:21:07 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-03d0a940-8e78-4401-a86e-7ddc6da46fe3 tempest-SnapshotDataIntegrityTests-5458625 tempest-SnapshotDataIntegrityTests-5458625-project-member] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 03 18:21:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] Acquiring lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:08 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] Lock "543c9dcb-8e55-4423-a77b-1492b8044c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:08 user nova-compute[75463]: DEBUG nova.compute.manager [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] No waiting events found dispatching network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b {{(pid=75463) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 03 18:21:08 user nova-compute[75463]: WARNING nova.compute.manager [req-a72b6aef-6f22-450b-86c8-3c514bf50f42 req-6c740de3-742b-4193-a796-a16391cbfd52 service nova] [instance: 543c9dcb-8e55-4423-a77b-1492b8044c1b] Received unexpected event network-vif-plugged-9883196c-fd1f-4268-ba67-2371e41f2e9b for instance with vm_state deleted and task_state None.
Nov 03 18:21:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:18 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:30 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:21:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:21:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:21:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:21:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:21:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:21:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.052974700927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:21:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:21:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:21:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:21:59 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:02 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:02 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:28 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:22:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:22:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:22:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:37 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:37 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:37 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:22:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:22:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:22:42 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:22:42 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9126MB free_disk=25.050182342529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:22:42 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:22:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:22:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:22:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:22:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:23:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:20 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:30 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:34 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:23:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:23:34 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:23:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:23:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:23:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:23:43 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:23:43 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=25.048866271972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:23:43 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:23:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:23:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:23:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:23:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:24:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:21 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:24:29 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:24:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:24:36 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:24:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:24:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:24:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:24:44 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:24:44 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=25.047714233398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:24:44 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:24:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:24:46 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:24:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:24:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:19 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:22 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:25:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:31 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:38 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:25:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:44 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:25:45 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:25:45 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:25:45 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=25.046382904052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:25:45 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing inventories for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating ProviderTree inventory for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Updating inventory in ProviderTree for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing aggregate associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, aggregates: None {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Refreshing trait associations for resource provider 6300a99a-c996-4cbe-994c-ecbcd97eb045, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV {{(pid=75463) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:25:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:25:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:25:58 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:25:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 03 18:25:58 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] There are 0 instances to clean {{(pid=75463) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 03 18:26:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:06 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75463) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 03 18:26:07 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:26:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:35 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:39 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:26:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:26:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:26:40 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:26:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:42 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:26:46 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:26:47 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:26:47 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9124MB free_disk=25.037288665771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:26:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:26:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:26:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:26:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:06 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:32 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:36 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:40 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:27:45 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:27:47 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:27:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:27:47 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:27:47 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:27:48 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:27:48 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=25.03632354736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:27:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:27:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:27:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:27:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:28:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:08 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:24 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:28:37 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:28:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:28:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:47 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:28:48 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:28:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:28:49 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=25.034996032714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:28:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:28:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:28:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:29:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:29:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:20 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:26 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:29:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:41 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:42 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Starting heal instance info cache {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 03 18:29:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Rebuilding the list of instances to heal {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 03 18:29:42 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Didn't find any instances for network info cache update. {{(pid=75463) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 03 18:29:43 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:43 user nova-compute[75463]: DEBUG nova.compute.manager [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75463) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 03 18:29:46 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:29:48 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:49 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:29:49 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:29:49 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Auditing locally available compute resources for user (node: user) {{(pid=75463) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 03 18:29:50 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:29:50 user nova-compute[75463]: WARNING nova.virt.libvirt.driver [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=25.033767700195312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=75463) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75463) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.compute.provider_tree [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed in ProviderTree for provider: 6300a99a-c996-4cbe-994c-ecbcd97eb045 {{(pid=75463) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.scheduler.client.report [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Inventory has not changed for provider 6300a99a-c996-4cbe-994c-ecbcd97eb045 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75463) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG nova.compute.resource_tracker [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Compute_service record updated for user:user {{(pid=75463) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 03 18:29:50 user nova-compute[75463]: DEBUG oslo_concurrency.lockutils [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75463) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 03 18:29:51 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:29:51 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:29:56 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:30:01 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:06 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:09 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75463) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75463) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 03 18:30:11 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:16 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:17 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:21 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:26 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 03 18:30:27 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:30:31 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:33 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:30:36 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 03 18:30:39 user nova-compute[75463]: DEBUG oslo_service.periodic_task [None req-f6f3e9b7-6270-4f38-af6e-cc2764763c77 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75463) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 03 18:30:41 user nova-compute[75463]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75463) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}